2017-12-06 22:38:38,358 INFO [main] hbase.HBaseTestingUtility(945): Starting up minicluster with 1 master(s) and 1 regionserver(s) and 1 datanode(s) 2017-12-06 22:38:38,402 INFO [main] hbase.HBaseZKTestingUtility(86): Created new mini-cluster data directory: /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb, deleteOnExit=true 2017-12-06 22:38:38,403 INFO [main] hbase.HBaseTestingUtility(960): STARTING DFS 2017-12-06 22:38:38,454 INFO [main] hbase.HBaseTestingUtility(737): Setting test.cache.data to /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cache_data in system properties and HBase conf 2017-12-06 22:38:38,454 INFO [main] hbase.HBaseTestingUtility(737): Setting hadoop.tmp.dir to /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/hadoop_tmp in system properties and HBase conf 2017-12-06 22:38:38,455 INFO [main] hbase.HBaseTestingUtility(737): Setting hadoop.log.dir to /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/hadoop_logs in system properties and HBase conf 2017-12-06 22:38:38,455 INFO [main] hbase.HBaseTestingUtility(737): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/mapred_local in system properties and HBase conf 2017-12-06 22:38:38,456 INFO [main] hbase.HBaseTestingUtility(737): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/mapred_temp in system properties and HBase conf 2017-12-06 22:38:38,456 INFO [main] hbase.HBaseTestingUtility(728): read short circuit is OFF 2017-12-06 22:38:38,586 WARN [main] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2017-12-06 22:38:39,039 DEBUG [main] fs.HFileSystem(318): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2017-12-06 22:38:40,616 WARN [main] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2017-12-06 22:38:40,846 INFO [main] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2017-12-06 22:38:40,942 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2017-12-06 22:38:40,977 INFO [main] log.Slf4jLog(67): Extract jar:file:/home/jenkins/yetus-m2/hbase-flaky-tests/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_44817_hdfs____t1e6iw/webapp 2017-12-06 22:38:41,180 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44817 2017-12-06 22:38:42,020 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2017-12-06 22:38:42,028 INFO [main] log.Slf4jLog(67): Extract jar:file:/home/jenkins/yetus-m2/hbase-flaky-tests/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_60695_datanode____.y2slz5/webapp 2017-12-06 22:38:42,158 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60695 2017-12-06 22:38:43,432 ERROR [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data1/, [DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:51925] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2017-12-06 22:38:43,514 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x7f86da6f8e6c1: from storage DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae node DatanodeRegistration(127.0.0.1:55766, datanodeUuid=f216d282-741f-4d5d-a8a5-ae3ac72cf164, infoPort=50973, infoSecurePort=0, ipcPort=44137, storageInfo=lv=-56;cid=testClusterID;nsid=1792055069;c=0), blocks: 0, hasStaleStorage: true, processing time: 3 msecs 2017-12-06 22:38:43,515 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x7f86da6f8e6c1: from storage DS-60fd6215-0471-4c98-8e9e-ca420144bc62 node DatanodeRegistration(127.0.0.1:55766, datanodeUuid=f216d282-741f-4d5d-a8a5-ae3ac72cf164, infoPort=50973, infoSecurePort=0, ipcPort=44137, storageInfo=lv=-56;cid=testClusterID;nsid=1792055069;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2017-12-06 22:38:43,644 ERROR [main] server.ZooKeeperServer(472): ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 2017-12-06 22:38:43,661 INFO [main] zookeeper.MiniZooKeeperCluster(277): Started MiniZooKeeperCluster and ran successful 'stat' on client port=49877 2017-12-06 22:38:43,675 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:43,678 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:44,076 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 7 2017-12-06 22:38:44,491 INFO [main] util.FSUtils(513): Created version file at hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5 with version=8 2017-12-06 22:38:44,491 INFO [main] hbase.HBaseTestingUtility(1199): The hbase.fs.tmp.dir is set to /user/jenkins/hbase-staging 2017-12-06 22:38:44,563 DEBUG [main] logging.Slf4JLogger(71): Using SLF4J as the default logging framework 2017-12-06 22:38:44,564 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.eventLoopThreads: 32 2017-12-06 22:38:44,578 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.noUnsafe: false 2017-12-06 22:38:44,579 DEBUG [main] logging.Slf4JLogger(76): Java version: 8 2017-12-06 22:38:44,580 DEBUG [main] logging.Slf4JLogger(71): sun.misc.Unsafe.theUnsafe: available 2017-12-06 22:38:44,580 DEBUG [main] logging.Slf4JLogger(71): sun.misc.Unsafe.copyMemory: available 2017-12-06 22:38:44,581 DEBUG [main] logging.Slf4JLogger(71): java.nio.Buffer.address: available 2017-12-06 22:38:44,581 DEBUG [main] logging.Slf4JLogger(71): direct buffer constructor: available 2017-12-06 22:38:44,582 DEBUG [main] logging.Slf4JLogger(76): java.nio.Bits.unaligned: available, true 2017-12-06 22:38:44,582 DEBUG [main] logging.Slf4JLogger(71): jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2017-12-06 22:38:44,582 DEBUG [main] logging.Slf4JLogger(76): java.nio.DirectByteBuffer.(long, int): available 2017-12-06 22:38:44,583 DEBUG [main] logging.Slf4JLogger(76): sun.misc.Unsafe: available 2017-12-06 22:38:44,583 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2017-12-06 22:38:44,583 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.bitMode: 64 (sun.arch.data.model) 2017-12-06 22:38:44,584 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.noPreferDirect: false 2017-12-06 22:38:44,584 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.maxDirectMemory: 2609905664 bytes 2017-12-06 22:38:44,584 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.uninitializedArrayAllocationThreshold: -1 2017-12-06 22:38:44,585 DEBUG [main] logging.Slf4JLogger(71): java.nio.ByteBuffer.cleaner(): available 2017-12-06 22:38:44,587 DEBUG [main] logging.Slf4JLogger(71): -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2017-12-06 22:38:44,587 DEBUG [main] logging.Slf4JLogger(71): -Dio.netty.native.workdir: /tmp (io.netty.tmpdir) 2017-12-06 22:38:44,600 DEBUG [main] logging.Slf4JLogger(76): -Djava.net.preferIPv4Stack: true 2017-12-06 22:38:44,600 DEBUG [main] logging.Slf4JLogger(76): -Djava.net.preferIPv6Addresses: false 2017-12-06 22:38:44,602 DEBUG [main] logging.Slf4JLogger(86): Loopback interface: lo (lo, 127.0.0.1) 2017-12-06 22:38:44,602 DEBUG [main] logging.Slf4JLogger(81): /proc/sys/net/core/somaxconn: 128 2017-12-06 22:38:44,627 DEBUG [main] logging.Slf4JLogger(71): org.jctools-core.MpscChunkedArrayQueue: available 2017-12-06 22:38:44,712 INFO [main] metrics.MetricRegistriesLoader(65): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2017-12-06 22:38:44,971 INFO [main] client.ConnectionUtils(123): master/asf911.gq1.ygridcore.net/67.195.81.155:0 server-side Connection retries=30 2017-12-06 22:38:44,991 INFO [main] ipc.RpcExecutor(148): RpcExecutor default.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=5 2017-12-06 22:38:44,993 INFO [main] ipc.RpcExecutor(148): RpcExecutor priority.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=6 2017-12-06 22:38:44,993 INFO [main] ipc.RpcExecutor(148): RpcExecutor replication.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=3 2017-12-06 22:38:45,143 INFO [main] ipc.RpcServerFactory(59): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.ClientService, hbase.pb.AdminService 2017-12-06 22:38:45,312 INFO [main] io.ByteBufferPool(83): Created ByteBufferPool with bufferSize : 65536 and maxPoolSize : 320 2017-12-06 22:38:45,324 DEBUG [main] util.ClassSize(230): Using Unsafe to estimate memory layout 2017-12-06 22:38:45,345 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.processId: 23884 (auto-detected) 2017-12-06 22:38:45,347 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.machineId: 78:e3:b5:ff:fe:17:a9:18 (auto-detected) 2017-12-06 22:38:45,361 DEBUG [main] logging.Slf4JLogger(81): -Dorg.apache.hadoop.hbase.shaded.io.netty.leakDetection.level: simple 2017-12-06 22:38:45,362 DEBUG [main] logging.Slf4JLogger(81): -Dorg.apache.hadoop.hbase.shaded.io.netty.leakDetection.maxRecords: 4 2017-12-06 22:38:45,388 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.numHeapArenas: 25 2017-12-06 22:38:45,388 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.numDirectArenas: 25 2017-12-06 22:38:45,388 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.pageSize: 8192 2017-12-06 22:38:45,389 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.maxOrder: 11 2017-12-06 22:38:45,389 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.chunkSize: 16777216 2017-12-06 22:38:45,389 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.tinyCacheSize: 512 2017-12-06 22:38:45,389 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.smallCacheSize: 256 2017-12-06 22:38:45,389 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.normalCacheSize: 64 2017-12-06 22:38:45,390 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2017-12-06 22:38:45,390 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.cacheTrimInterval: 8192 2017-12-06 22:38:45,390 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.useCacheForAllThreads: true 2017-12-06 22:38:45,401 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.allocator.type: pooled 2017-12-06 22:38:45,401 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.threadLocalDirectBufferSize: 65536 2017-12-06 22:38:45,401 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.maxThreadLocalCharBufferSize: 16384 2017-12-06 22:38:45,415 INFO [main] ipc.NettyRpcServer(108): NettyRpcServer bind to address=/67.195.81.155:39318 2017-12-06 22:38:45,435 INFO [main] hfile.CacheConfig(591): Allocating LruBlockCache size=995.60 MB, blockSize=64 KB 2017-12-06 22:38:45,442 DEBUG [main] hfile.CacheConfig(606): Trying to use Internal l2 cache 2017-12-06 22:38:45,443 INFO [main] hfile.CacheConfig(283): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:45,444 INFO [main] hfile.CacheConfig(283): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:45,447 DEBUG [main] mob.MobFileCache(123): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2017-12-06 22:38:45,448 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:45,452 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:45,506 INFO [main] zookeeper.RecoverableZooKeeper(107): Process identifier=master:39318 connecting to ZooKeeper ensemble=localhost:49877 2017-12-06 22:38:45,589 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:393180x0, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-12-06 22:38:45,591 DEBUG [main-EventThread] zookeeper.ZKWatcher(523): master:39318-0x1602dfb2ba70000 connected 2017-12-06 22:38:45,694 DEBUG [main] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-12-06 22:38:45,695 DEBUG [main] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-12-06 22:38:45,907 DEBUG [main] ipc.RpcExecutor(255): Started 0 default.FPBQ.Fifo handlers, qsize=1 on port=39318 2017-12-06 22:38:45,910 DEBUG [main] ipc.RpcExecutor(255): Started 0 priority.FPBQ.Fifo handlers, qsize=1 on port=39318 2017-12-06 22:38:45,911 DEBUG [main] ipc.RpcExecutor(255): Started 0 replication.FPBQ.Fifo handlers, qsize=1 on port=39318 2017-12-06 22:38:45,917 INFO [main] master.HMaster(474): hbase.rootdir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5, hbase.cluster.distributed=false 2017-12-06 22:38:45,936 INFO [main] master.HMaster(1995): Adding backup master ZNode /hbase/backup-masters/asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:45,953 DEBUG [main] zookeeper.ZKUtil(342): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:46,002 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2017-12-06 22:38:46,003 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(342): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-12-06 22:38:46,005 INFO [asf911:39318.masterManager] master.ActiveMasterManager(172): Deleting ZNode for /hbase/backup-masters/asf911.gq1.ygridcore.net,39318,1512599924553 from backup master directory 2017-12-06 22:38:46,018 DEBUG [main-EventThread] zookeeper.ZKUtil(342): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-12-06 22:38:46,018 DEBUG [main-EventThread] master.ActiveMasterManager(128): A master is now available 2017-12-06 22:38:46,018 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:46,019 WARN [asf911:39318.masterManager] hbase.ZNodeClearer(62): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2017-12-06 22:38:46,019 INFO [asf911:39318.masterManager] master.ActiveMasterManager(181): Registered Active Master=asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:46,024 INFO [asf911:39318.masterManager] regionserver.ChunkCreator(407): Allocating MemStoreChunkPool with chunk size 2 MB, max count 497, initial count 0 2017-12-06 22:38:46,036 INFO [main] client.ConnectionUtils(123): regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0 server-side Connection retries=30 2017-12-06 22:38:46,036 INFO [main] ipc.RpcExecutor(148): RpcExecutor default.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=5 2017-12-06 22:38:46,036 INFO [main] ipc.RpcExecutor(148): RpcExecutor priority.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=6 2017-12-06 22:38:46,037 INFO [main] ipc.RpcExecutor(148): RpcExecutor replication.FPBQ using fifo as call queue; numCallQueues=1; maxQueueLength=50; handlerCount=3 2017-12-06 22:38:46,041 INFO [main] ipc.RpcServerFactory(59): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2017-12-06 22:38:46,042 INFO [main] io.ByteBufferPool(83): Created ByteBufferPool with bufferSize : 65536 and maxPoolSize : 320 2017-12-06 22:38:46,046 INFO [main] ipc.NettyRpcServer(108): NettyRpcServer bind to address=/67.195.81.155:43202 2017-12-06 22:38:46,047 INFO [main] hfile.CacheConfig(283): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,047 INFO [main] hfile.CacheConfig(283): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,049 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:46,053 INFO [main] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:46,057 INFO [main] zookeeper.RecoverableZooKeeper(107): Process identifier=regionserver:43202 connecting to ZooKeeper ensemble=localhost:49877 2017-12-06 22:38:46,068 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): regionserver:432020x0, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-12-06 22:38:46,069 DEBUG [main-EventThread] zookeeper.ZKWatcher(523): regionserver:43202-0x1602dfb2ba70001 connected 2017-12-06 22:38:46,069 DEBUG [main] zookeeper.ZKUtil(342): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-12-06 22:38:46,071 DEBUG [main] zookeeper.ZKUtil(344): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-12-06 22:38:46,072 DEBUG [main] ipc.RpcExecutor(255): Started 0 default.FPBQ.Fifo handlers, qsize=1 on port=43202 2017-12-06 22:38:46,073 DEBUG [main] ipc.RpcExecutor(255): Started 0 priority.FPBQ.Fifo handlers, qsize=1 on port=43202 2017-12-06 22:38:46,074 DEBUG [main] ipc.RpcExecutor(255): Started 0 replication.FPBQ.Fifo handlers, qsize=1 on port=43202 2017-12-06 22:38:46,109 INFO [RS:0;asf911:43202] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x5adb9ac4 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:38:46,109 INFO [M:0;asf911:39318] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x3fa528d8 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:38:46,165 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|FINALIZED]]} size 0 2017-12-06 22:38:46,169 DEBUG [asf911:39318.masterManager] util.FSUtils(665): Created cluster ID file at hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/hbase.id with ID: eb177224-91e4-4389-b545-188e92e2cf19 2017-12-06 22:38:46,180 WARN [RS:0;asf911:43202] client.ConnectionImplementation(522): Retrieve cluster id failed java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/hbaseid at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.hbase.client.ConnectionImplementation.retrieveClusterId(ConnectionImplementation.java:520) at org.apache.hadoop.hbase.client.ConnectionImplementation.(ConnectionImplementation.java:288) at org.apache.hadoop.hbase.client.ConnectionUtils$ShortCircuitingClusterConnection.(ConnectionUtils.java:142) at org.apache.hadoop.hbase.client.ConnectionUtils$ShortCircuitingClusterConnection.(ConnectionUtils.java:133) at org.apache.hadoop.hbase.client.ConnectionUtils.createShortCircuitConnection(ConnectionUtils.java:186) at org.apache.hadoop.hbase.regionserver.HRegionServer.createClusterConnection(HRegionServer.java:775) at org.apache.hadoop.hbase.regionserver.HRegionServer.setupClusterConnection(HRegionServer.java:806) at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:821) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:932) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:163) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:110) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:147) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1726) at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:305) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:145) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/hbaseid at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$ZKTask$1.exec(ReadOnlyZKClient.java:164) at org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:312) ... 1 more 2017-12-06 22:38:46,180 WARN [M:0;asf911:39318] client.ConnectionImplementation(522): Retrieve cluster id failed java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/hbaseid at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.hbase.client.ConnectionImplementation.retrieveClusterId(ConnectionImplementation.java:520) at org.apache.hadoop.hbase.client.ConnectionImplementation.(ConnectionImplementation.java:288) at org.apache.hadoop.hbase.client.ConnectionUtils$ShortCircuitingClusterConnection.(ConnectionUtils.java:142) at org.apache.hadoop.hbase.client.ConnectionUtils$ShortCircuitingClusterConnection.(ConnectionUtils.java:133) at org.apache.hadoop.hbase.client.ConnectionUtils.createShortCircuitConnection(ConnectionUtils.java:186) at org.apache.hadoop.hbase.regionserver.HRegionServer.createClusterConnection(HRegionServer.java:775) at org.apache.hadoop.hbase.regionserver.HRegionServer.setupClusterConnection(HRegionServer.java:806) at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:821) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:932) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:544) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/hbaseid at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$ZKTask$1.exec(ReadOnlyZKClient.java:164) at org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:312) ... 1 more 2017-12-06 22:38:46,186 DEBUG [M:0;asf911:39318] client.ConnectionImplementation(526): clusterid came back null, using default default-cluster 2017-12-06 22:38:46,185 DEBUG [RS:0;asf911:43202] client.ConnectionImplementation(526): clusterid came back null, using default default-cluster 2017-12-06 22:38:46,200 DEBUG [RS:0;asf911:43202] logging.Slf4JLogger(76): Loaded default ResourceLeakDetector: org.apache.hadoop.hbase.shaded.io.netty.util.ResourceLeakDetector@12745c8c 2017-12-06 22:38:46,212 INFO [asf911:39318.masterManager] master.MasterFileSystem(386): BOOTSTRAP: creating hbase:meta region 2017-12-06 22:38:46,212 DEBUG [M:0;asf911:39318] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4116cc8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:38:46,212 DEBUG [RS:0;asf911:43202] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1333d912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:38:46,223 INFO [asf911:39318.masterManager] regionserver.HRegion(6731): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'false', BLOCKSIZE => '8192'}, {NAME => 'rep_barrier', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_meta', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_position', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'table', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5 Table name == hbase:meta 2017-12-06 22:38:46,256 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|FINALIZED]]} size 0 2017-12-06 22:38:46,264 DEBUG [asf911:39318.masterManager] regionserver.HRegion(799): Instantiated hbase:meta,,1.1588230740 2017-12-06 22:38:46,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/info 2017-12-06 22:38:46,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:46,353 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:46,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_barrier 2017-12-06 22:38:46,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:46,388 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,388 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:46,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_meta 2017-12-06 22:38:46,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:46,396 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_meta: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,397 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:46,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_position 2017-12-06 22:38:46,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:46,404 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_position: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,405 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:46,413 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/table 2017-12-06 22:38:46,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:46,414 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:46,414 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:46,426 DEBUG [asf911:39318.masterManager] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740 2017-12-06 22:38:46,447 DEBUG [asf911:39318.masterManager] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table hbase:meta, use config (26843545) instead 2017-12-06 22:38:46,456 DEBUG [asf911:39318.masterManager] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:46,456 INFO [asf911:39318.masterManager] regionserver.HRegion(950): Onlined 1588230740; next sequenceid=2 2017-12-06 22:38:46,457 DEBUG [asf911:39318.masterManager] regionserver.HRegion(1471): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2017-12-06 22:38:46,457 DEBUG [asf911:39318.masterManager] regionserver.HRegion(1510): Updates disabled for region hbase:meta,,1.1588230740 2017-12-06 22:38:46,459 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed info 2017-12-06 22:38:46,460 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_barrier 2017-12-06 22:38:46,460 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_meta 2017-12-06 22:38:46,460 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_position 2017-12-06 22:38:46,460 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed table 2017-12-06 22:38:46,462 INFO [asf911:39318.masterManager] regionserver.HRegion(1623): Closed hbase:meta,,1.1588230740 2017-12-06 22:38:46,505 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741828_1004{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 2448 2017-12-06 22:38:46,913 DEBUG [asf911:39318.masterManager] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2017-12-06 22:38:46,965 INFO [asf911:39318.masterManager] fs.HFileSystem(349): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-12-06 22:38:46,985 INFO [asf911:39318.masterManager] coordination.ZKSplitLogManagerCoordination(492): Found 0 orphan tasks and 0 rescan nodes 2017-12-06 22:38:46,986 DEBUG [asf911:39318.masterManager] util.FSTableDescriptors(304): Fetching table descriptors from the filesystem. 2017-12-06 22:38:47,049 INFO [asf911:39318.masterManager] balancer.BaseLoadBalancer(1037): slop=0.001, tablesOnMaster=false, systemTablesOnMaster=false 2017-12-06 22:38:47,058 INFO [asf911:39318.masterManager] balancer.StochasticLoadBalancer(216): Loaded config; maxSteps=1000000, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, etc. 2017-12-06 22:38:47,062 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2017-12-06 22:38:47,063 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2017-12-06 22:38:47,077 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2017-12-06 22:38:47,078 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2017-12-06 22:38:47,108 INFO [asf911:39318.masterManager] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:38:47,175 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2017-12-06 22:38:47,176 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2017-12-06 22:38:47,177 INFO [asf911:39318.masterManager] master.HMaster(725): Server active/primary master=asf911.gq1.ygridcore.net,39318,1512599924553, sessionid=0x1602dfb2ba70000, setting cluster-up flag (Was=false) 2017-12-06 22:38:47,180 INFO [RS:0;asf911:43202] regionserver.HRegionServer(867): ClusterId : eb177224-91e4-4389-b545-188e92e2cf19 2017-12-06 22:38:47,181 INFO [M:0;asf911:39318] regionserver.HRegionServer(867): ClusterId : eb177224-91e4-4389-b545-188e92e2cf19 2017-12-06 22:38:47,192 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2017-12-06 22:38:47,234 DEBUG [RS:0;asf911:43202] zookeeper.RecoverableZooKeeper(613): Node /hbase/flush-table-proc/acquired already exists 2017-12-06 22:38:47,252 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2017-12-06 22:38:47,252 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2017-12-06 22:38:47,292 DEBUG [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(613): Node /hbase/flush-table-proc/abort already exists 2017-12-06 22:38:47,293 INFO [asf911:39318.masterManager] procedure.ZKProcedureUtil(271): Clearing all procedure znodes: /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2017-12-06 22:38:47,359 DEBUG [asf911:39318.masterManager] procedure.ZKProcedureCoordinator(248): Starting the controller for procedure member:asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:47,401 DEBUG [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(613): Node /hbase/online-snapshot/acquired already exists 2017-12-06 22:38:47,467 DEBUG [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(613): Node /hbase/online-snapshot/reached already exists 2017-12-06 22:38:47,492 INFO [asf911:39318.masterManager] procedure.ZKProcedureUtil(271): Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2017-12-06 22:38:47,493 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2017-12-06 22:38:47,493 DEBUG [RS:0;asf911:43202] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dda73ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=asf911.gq1.ygridcore.net/67.195.81.155:0 2017-12-06 22:38:47,494 DEBUG [asf911:39318.masterManager] procedure.ZKProcedureCoordinator(248): Starting the controller for procedure member:asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:38:47,498 DEBUG [RS:0;asf911:43202] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:0;asf911:43202 2017-12-06 22:38:47,509 INFO [RS:0;asf911:43202] regionserver.RegionServerCoprocessorHost(64): System coprocessor loading is enabled 2017-12-06 22:38:47,509 INFO [RS:0;asf911:43202] regionserver.RegionServerCoprocessorHost(65): Table coprocessor loading is enabled 2017-12-06 22:38:47,513 INFO [RS:0;asf911:43202] regionserver.HRegionServer(2618): reportForDuty to master=asf911.gq1.ygridcore.net,39318,1512599924553 with port=43202, startcode=1512599926033 2017-12-06 22:38:47,537 DEBUG [RS:0;asf911:43202] logging.Slf4JLogger(81): -Dorg.apache.hadoop.hbase.shaded.io.netty.buffer.bytebuf.checkAccessible: true 2017-12-06 22:38:47,537 DEBUG [RS:0;asf911:43202] logging.Slf4JLogger(76): Loaded default ResourceLeakDetector: org.apache.hadoop.hbase.shaded.io.netty.util.ResourceLeakDetector@640a936f 2017-12-06 22:38:47,547 INFO [asf911:39318.masterManager] master.MasterCoprocessorHost(156): System coprocessor loading is enabled 2017-12-06 22:38:47,549 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=MASTER_OPEN_REGION-asf911:39318, corePoolSize=5, maxPoolSize=5 2017-12-06 22:38:47,549 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=MASTER_CLOSE_REGION-asf911:39318, corePoolSize=5, maxPoolSize=5 2017-12-06 22:38:47,549 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=MASTER_SERVER_OPERATIONS-asf911:39318, corePoolSize=5, maxPoolSize=5 2017-12-06 22:38:47,549 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=MASTER_META_SERVER_OPERATIONS-asf911:39318, corePoolSize=5, maxPoolSize=5 2017-12-06 22:38:47,550 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=M_LOG_REPLAY_OPS-asf911:39318, corePoolSize=10, maxPoolSize=10 2017-12-06 22:38:47,550 DEBUG [asf911:39318.masterManager] executor.ExecutorService(92): Starting executor service name=MASTER_TABLE_OPERATIONS-asf911:39318, corePoolSize=1, maxPoolSize=1 2017-12-06 22:38:47,554 DEBUG [RS:0;asf911:43202] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:39318 2017-12-06 22:38:47,579 INFO [asf911:39318.masterManager] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:38:47,581 INFO [asf911:39318.masterManager] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:38:47,582 DEBUG [RS-EventLoopGroup-3-2] logging.Slf4JLogger(76): -Dio.netty.recycler.maxCapacityPerThread: 32768 2017-12-06 22:38:47,582 DEBUG [RS-EventLoopGroup-3-2] logging.Slf4JLogger(76): -Dio.netty.recycler.maxSharedCapacityFactor: 2 2017-12-06 22:38:47,582 DEBUG [RS-EventLoopGroup-3-2] logging.Slf4JLogger(76): -Dio.netty.recycler.linkCapacity: 16 2017-12-06 22:38:47,582 DEBUG [RS-EventLoopGroup-3-2] logging.Slf4JLogger(76): -Dio.netty.recycler.ratio: 8 2017-12-06 22:38:47,585 DEBUG [RS-EventLoopGroup-1-2] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:54342; # active connections: 0 2017-12-06 22:38:47,593 WARN [asf911:39318.masterManager] util.CommonFSUtils$StreamCapabilities(822): Your Hadoop installation does not include the StreamCapabilities class from HDFS-11644, so we will skip checking if any FSDataOutputStreams actually support hflush/hsync. If you are running on top of HDFS this probably just means you have an older version and this can be ignored. If you are running on top of an alternate FileSystem implementation you should manually verify that hflush and hsync are implemented; otherwise you risk data loss and hard to diagnose errors when our assumptions are violated. 2017-12-06 22:38:47,593 DEBUG [asf911:39318.masterManager] util.CommonFSUtils$StreamCapabilities(829): The first request to check for StreamCapabilities came from this stacktrace. java.lang.ClassNotFoundException: org.apache.hadoop.fs.StreamCapabilities at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.util.CommonFSUtils$StreamCapabilities.(CommonFSUtils.java:818) at org.apache.hadoop.hbase.util.CommonFSUtils.hasCapability(CommonFSUtils.java:856) at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.rollWriter(WALProcedureStore.java:1031) at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.recoverLease(WALProcedureStore.java:371) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.start(ProcedureExecutor.java:531) at org.apache.hadoop.hbase.master.HMaster.startProcedureExecutor(HMaster.java:1222) at org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:1126) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:816) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:223) at org.apache.hadoop.hbase.master.HMaster$4.run(HMaster.java:2025) at java.lang.Thread.run(Thread.java:748) 2017-12-06 22:38:47,595 DEBUG [asf911:39318.masterManager] wal.WALProcedureStore(1067): Roll new state log: 1 2017-12-06 22:38:47,597 INFO [asf911:39318.masterManager] wal.WALProcedureStore(387): Lease acquired for flushLogId: 1 2017-12-06 22:38:47,598 INFO [asf911:39318.masterManager] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 16msec 2017-12-06 22:38:47,600 DEBUG [asf911:39318.masterManager] wal.WALProcedureStore(406): No state logs to replay. 2017-12-06 22:38:47,600 DEBUG [asf911:39318.masterManager] procedure2.ProcedureExecutor$1(316): Load max pid=0 2017-12-06 22:38:47,600 INFO [asf911:39318.masterManager] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 2msec 2017-12-06 22:38:47,601 INFO [asf911:39318.masterManager] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599957601 2017-12-06 22:38:47,602 INFO [asf911:39318.masterManager] procedure2.RemoteProcedureDispatcher(97): Starting procedure remote dispatcher; threads=128, queueMaxSize=32, operationDelay=150 2017-12-06 22:38:47,606 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2017-12-06 22:38:47,607 INFO [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(107): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:49877 2017-12-06 22:38:47,617 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(527): Auth successful for jenkins.hfs.0 (auth:SIMPLE) 2017-12-06 22:38:47,623 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 54342 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:47,626 DEBUG [asf911:39318.masterManager-EventThread] zookeeper.ZKWatcher(460): replicationLogCleaner0x0, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-12-06 22:38:47,627 DEBUG [asf911:39318.masterManager-EventThread] zookeeper.ZKWatcher(523): replicationLogCleaner-0x1602dfb2ba70004 connected 2017-12-06 22:38:47,627 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2017-12-06 22:38:47,631 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2017-12-06 22:38:47,631 INFO [asf911:39318.masterManager] cleaner.CleanerChore(113): Cleaner pool size is 8 2017-12-06 22:38:47,632 INFO [asf911:39318.masterManager] cleaner.LogCleaner(123): Creating OldWALs cleaners with size: 2 2017-12-06 22:38:47,638 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2017-12-06 22:38:47,641 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2017-12-06 22:38:47,643 DEBUG [asf911:39318.masterManager] cleaner.CleanerChore(160): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2017-12-06 22:38:47,646 DEBUG [asf911:39318.masterManager] cleaner.HFileCleaner(212): Starting hfile cleaner for large files: asf911:39318.masterManager-HFileCleaner.large.0-1512599927646 2017-12-06 22:38:47,646 DEBUG [asf911:39318.masterManager] cleaner.HFileCleaner(227): Starting hfile cleaner for small files: asf911:39318.masterManager-HFileCleaner.small.0-1512599927646 2017-12-06 22:38:47,661 INFO [asf911:39318.masterManager] master.HMaster(824): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1512599925989, completionTime=-1 2017-12-06 22:38:47,662 INFO [asf911:39318.masterManager] master.ServerManager(865): Waiting on RegionServer count=0 to settle; waited=0ms, expecting min=1 server(s), max=1 server(s), timeout=4500ms, lastChange=0ms 2017-12-06 22:38:47,687 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(2637): Master is not running yet 2017-12-06 22:38:47,687 WARN [RS:0;asf911:43202] regionserver.HRegionServer(951): reportForDuty failed; sleeping and then retrying. 2017-12-06 22:38:48,689 INFO [RS:0;asf911:43202] regionserver.HRegionServer(2618): reportForDuty to master=asf911.gq1.ygridcore.net,39318,1512599924553 with port=43202, startcode=1512599926033 2017-12-06 22:38:48,704 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.ServerManager(432): Registering server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,713 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1495): Config from master: hbase.rootdir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5 2017-12-06 22:38:48,714 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1495): Config from master: fs.defaultFS=hdfs://localhost:51925 2017-12-06 22:38:48,714 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1495): Config from master: hbase.master.info.port=-1 2017-12-06 22:38:48,714 INFO [asf911:39318.masterManager] master.ServerManager(881): Finished wait on RegionServer count=1; waited=1052ms, expected min=1 server(s), max=1 server(s), master is running 2017-12-06 22:38:48,734 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2017-12-06 22:38:48,735 DEBUG [RS:0;asf911:43202] zookeeper.ZKUtil(342): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,735 WARN [RS:0;asf911:43202] hbase.ZNodeClearer(62): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2017-12-06 22:38:48,736 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1800): logDir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,736 DEBUG [main-EventThread] zookeeper.ZKUtil(342): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,758 INFO [RS:0;asf911:43202] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2017-12-06 22:38:48,809 INFO [RS:0;asf911:43202] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x27c4e38f to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:38:48,827 DEBUG [RS:0;asf911:43202] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18e79540, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:38:48,828 DEBUG [RS:0;asf911:43202] regionserver.Replication(152): ReplicationStatisticsThread 300 2017-12-06 22:38:48,840 INFO [RS:0;asf911:43202] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2017-12-06 22:38:48,862 INFO [RS:0;asf911:43202] regionserver.MemStoreFlusher(105): globalMemStoreLimit=995.6 M, globalMemStoreLimitLowMark=945.8 M, Offheap=false 2017-12-06 22:38:48,868 INFO [RS:0;asf911:43202] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/sec, lower bound 10.00 MB/sec, off peak: unlimited, tuning period: 60000 ms 2017-12-06 22:38:48,870 INFO [RS:0;asf911:43202] regionserver.HRegionServer$CompactionChecker(1694): CompactionChecker runs every 1sec 2017-12-06 22:38:48,883 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-asf911:43202, corePoolSize=3, maxPoolSize=3 2017-12-06 22:38:48,884 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-asf911:43202, corePoolSize=1, maxPoolSize=1 2017-12-06 22:38:48,884 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-asf911:43202, corePoolSize=3, maxPoolSize=3 2017-12-06 22:38:48,885 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-asf911:43202, corePoolSize=3, maxPoolSize=3 2017-12-06 22:38:48,885 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-asf911:43202, corePoolSize=1, maxPoolSize=1 2017-12-06 22:38:48,885 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-asf911:43202, corePoolSize=2, maxPoolSize=2 2017-12-06 22:38:48,885 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-asf911:43202, corePoolSize=10, maxPoolSize=10 2017-12-06 22:38:48,885 DEBUG [RS:0;asf911:43202] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-asf911:43202, corePoolSize=3, maxPoolSize=3 2017-12-06 22:38:48,886 DEBUG [asf911:39318.masterManager] procedure2.ProcedureExecutor(868): Stored pid=1, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:38:48,889 INFO [asf911:39318.masterManager] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=1 2017-12-06 22:38:48,895 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=1, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:38:48,898 DEBUG [ProcExecWrkr-1] zookeeper.ZKUtil(601): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2017-12-06 22:38:48,902 DEBUG [ProcExecWrkr-1] master.MasterWalManager(170): No log files to split, proceeding... 2017-12-06 22:38:48,917 INFO [SplitLogWorker-asf911:43202] regionserver.SplitLogWorker(130): SplitLogWorker asf911.gq1.ygridcore.net,43202,1512599926033 starting 2017-12-06 22:38:48,921 INFO [RS:0;asf911:43202] regionserver.HeapMemoryManager(210): Starting HeapMemoryTuner chore. 2017-12-06 22:38:48,927 DEBUG [ReplicationExecutor-0] zookeeper.ZKUtil(342): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,928 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager$AdoptAbandonedQueuesWorker(788): Current list of replicators: [asf911.gq1.ygridcore.net,43202,1512599926033] other RSs: [asf911.gq1.ygridcore.net,43202,1512599926033] 2017-12-06 22:38:48,955 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1536): Serving as asf911.gq1.ygridcore.net,43202,1512599926033, RpcServer on asf911.gq1.ygridcore.net/67.195.81.155:43202, sessionid=0x1602dfb2ba70001 2017-12-06 22:38:48,955 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2017-12-06 22:38:48,955 DEBUG [RS:0;asf911:43202] flush.RegionServerFlushTableProcedureManager(103): Start region server flush procedure manager asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,955 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(352): Starting procedure member 'asf911.gq1.ygridcore.net,43202,1512599926033' 2017-12-06 22:38:48,956 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2017-12-06 22:38:48,956 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(151): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2017-12-06 22:38:48,959 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2017-12-06 22:38:48,959 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2017-12-06 22:38:48,959 DEBUG [RS:0;asf911:43202] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:48,959 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(352): Starting procedure member 'asf911.gq1.ygridcore.net,43202,1512599926033' 2017-12-06 22:38:48,959 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2017-12-06 22:38:48,960 DEBUG [RS:0;asf911:43202] procedure.ZKProcedureMemberRpcs(151): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2017-12-06 22:38:48,960 DEBUG [ProcExecWrkr-1] zookeeper.ZKUtil(601): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2017-12-06 22:38:48,960 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=1, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=null 2017-12-06 22:38:48,961 DEBUG [RS:0;asf911:43202] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2017-12-06 22:38:48,961 INFO [RS:0;asf911:43202] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2017-12-06 22:38:48,961 INFO [RS:0;asf911:43202] quotas.RegionServerSpaceQuotaManager(74): Quota support disabled, not starting space quota manager. 2017-12-06 22:38:48,968 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740}] 2017-12-06 22:38:49,018 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:38:49,022 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:49,177 DEBUG [AssignmentThread] assignment.AssignmentManager(1714): Processing assignment plans for System tables sysServersCount=1, allServersCount=1 2017-12-06 22:38:49,180 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:49,988 INFO [RS:0;asf911:43202] wal.AbstractFSWAL(410): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=asf911.gq1.ygridcore.net%2C43202%2C1512599926033, suffix=, logDir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033, archiveDir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:38:50,021 INFO [RS:0;asf911:43202] wal.AbstractFSWAL(693): New WAL /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033/asf911.gq1.ygridcore.net%2C43202%2C1512599926033.1512599929989 2017-12-06 22:38:50,021 DEBUG [RS:0;asf911:43202] wal.AbstractFSWAL(757): Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:55766,DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae,DISK]] 2017-12-06 22:38:50,070 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,092 DEBUG [ProcExecWrkr-1] zookeeper.MetaTableLocator(461): META region location doesn't exist, create it 2017-12-06 22:38:50,101 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,254 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:50,305 DEBUG [RSProcedureDispatcher-pool4-t1] master.ServerManager(777): New admin connection to asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,309 DEBUG [RSProcedureDispatcher-pool4-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:38:50,316 DEBUG [RS-EventLoopGroup-3-4] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46308; # active connections: 0 2017-12-06 22:38:50,319 INFO [RS-EventLoopGroup-3-4] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:38:50,319 INFO [RS-EventLoopGroup-3-4] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46308 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:50,330 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open hbase:meta,,1.1588230740 2017-12-06 22:38:50,334 INFO [RS_OPEN_META-asf911:43202-0] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2017-12-06 22:38:50,347 INFO [RS_OPEN_META-asf911:43202-0] wal.AbstractFSWAL(410): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=asf911.gq1.ygridcore.net%2C43202%2C1512599926033.meta, suffix=.meta, logDir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033, archiveDir=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:38:50,367 INFO [RS_OPEN_META-asf911:43202-0] wal.AbstractFSWAL(693): New WAL /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033/asf911.gq1.ygridcore.net%2C43202%2C1512599926033.meta.1512599930347.meta 2017-12-06 22:38:50,367 DEBUG [RS_OPEN_META-asf911:43202-0] wal.AbstractFSWAL(757): Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:55766,DS-60fd6215-0471-4c98-8e9e-ca420144bc62,DISK]] 2017-12-06 22:38:50,371 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2017-12-06 22:38:50,403 DEBUG [RS_OPEN_META-asf911:43202-0] coprocessor.CoprocessorHost(201): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2017-12-06 22:38:50,424 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.HRegion(7842): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2017-12-06 22:38:50,431 INFO [RS_OPEN_META-asf911:43202-0] regionserver.RegionCoprocessorHost(426): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2017-12-06 22:38:50,438 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table meta 1588230740 2017-12-06 22:38:50,438 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.HRegion(799): Instantiated hbase:meta,,1.1588230740 2017-12-06 22:38:50,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/info 2017-12-06 22:38:50,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/info 2017-12-06 22:38:50,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:50,452 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:50,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:50,457 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_barrier 2017-12-06 22:38:50,457 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_barrier 2017-12-06 22:38:50,458 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:50,458 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:50,458 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:50,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_meta 2017-12-06 22:38:50,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_meta 2017-12-06 22:38:50,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:50,464 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_meta: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:50,464 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:50,469 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_position 2017-12-06 22:38:50,469 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/rep_position 2017-12-06 22:38:50,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:50,469 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for rep_position: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:50,470 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:50,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/table 2017-12-06 22:38:50,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/table 2017-12-06 22:38:50,475 INFO [StoreOpener-1588230740-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:50,475 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(258): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:50,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:50,482 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740 2017-12-06 22:38:50,486 DEBUG [RS_OPEN_META-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table hbase:meta, use config (26843545) instead 2017-12-06 22:38:50,512 DEBUG [RS_OPEN_META-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/recovered.edits/3.seqid, newSeqId=3, maxSeqId=2 2017-12-06 22:38:50,514 INFO [RS_OPEN_META-asf911:43202-0] regionserver.HRegion(950): Onlined 1588230740; next sequenceid=3 2017-12-06 22:38:50,559 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2204): Post open deploy tasks for hbase:meta,,1.1588230740 2017-12-06 22:38:50,581 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=3, pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,585 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2228): Finished post open deploy task for hbase:meta,,1.1588230740 2017-12-06 22:38:50,588 DEBUG [RS_OPEN_META-asf911:43202-0] handler.OpenRegionHandler(129): Opened hbase:meta,,1.1588230740 on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,655 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599930591}]},"ts":1512599930591} 2017-12-06 22:38:50,731 DEBUG [hconnection-0x62050c2d-shared-pool8-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:38:50,737 DEBUG [RS-EventLoopGroup-3-6] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46320; # active connections: 1 2017-12-06 22:38:50,746 INFO [RS-EventLoopGroup-3-6] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:38:50,747 INFO [RS-EventLoopGroup-3-6] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46320 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:50,810 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:38:50,811 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:50,817 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2017-12-06 22:38:50,859 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=2, ppid=1, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740 2017-12-06 22:38:50,892 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=1, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:38:50,893 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=2, ppid=1, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740 in 1.8530sec 2017-12-06 22:38:50,925 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 2.1690sec 2017-12-06 22:38:50,927 INFO [asf911:39318.masterManager] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:51,007 DEBUG [asf911:39318.masterManager] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:38:51,015 INFO [asf911:39318.masterManager] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:38:51,016 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:38:51,022 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:38:51,022 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:38:51,023 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:38:51,023 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:38:51,023 INFO [asf911:39318.masterManager] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599936023 2017-12-06 22:38:51,023 INFO [asf911:39318.masterManager] assignment.AssignmentManager(1174): Joined the cluster in 7msec, failover=false 2017-12-06 22:38:51,064 INFO [asf911:39318.masterManager] master.TableNamespaceManager(91): Namespace table not found. Creating... 2017-12-06 22:38:51,071 INFO [asf911:39318.masterManager] master.HMaster(1773): Client=null/null create 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} 2017-12-06 22:38:51,118 DEBUG [asf911:39318.masterManager] procedure2.ProcedureExecutor(868): Stored pid=3, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2017-12-06 22:38:51,192 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741832_1008{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 502 2017-12-06 22:38:51,602 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2017-12-06 22:38:51,607 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(6731): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == hbase:namespace 2017-12-06 22:38:51,641 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:38:51,642 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(799): Instantiated hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:51,643 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1471): Closing hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.: disabling compactions & flushes 2017-12-06 22:38:51,643 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1510): Updates disabled for region hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:51,643 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1623): Closed hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:51,745 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:38:51,753 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:38:51,834 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599931834}]},"ts":1512599931834} 2017-12-06 22:38:51,841 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:namespace state to ENABLING in META 2017-12-06 22:38:51,842 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d}] 2017-12-06 22:38:51,892 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d hbase:namespace hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:51,898 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:52,048 DEBUG [AssignmentThread] assignment.AssignmentManager(1714): Processing assignment plans for System tables sysServersCount=1, allServersCount=1 2017-12-06 22:38:52,050 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=4 updating hbase:meta row=hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:52,065 INFO [ProcExecWrkr-1] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x6008709b to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:38:52,085 DEBUG [ProcExecWrkr-1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39836480, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:38:52,088 DEBUG [MultiHConnection-shared--pool9-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:38:52,094 DEBUG [RS-EventLoopGroup-3-8] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46352; # active connections: 2 2017-12-06 22:38:52,097 INFO [RS-EventLoopGroup-3-8] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:38:52,098 INFO [RS-EventLoopGroup-3-8] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46352 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:52,106 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:52,257 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:52,260 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:52,269 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} 2017-12-06 22:38:52,271 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table namespace 98664e5c7a903927b03ac89fe21a8d2d 2017-12-06 22:38:52,272 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:52,280 DEBUG [StoreOpener-98664e5c7a903927b03ac89fe21a8d2d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/info 2017-12-06 22:38:52,280 DEBUG [StoreOpener-98664e5c7a903927b03ac89fe21a8d2d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/info 2017-12-06 22:38:52,281 INFO [StoreOpener-98664e5c7a903927b03ac89fe21a8d2d-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2017-12-06 22:38:52,281 INFO [StoreOpener-98664e5c7a903927b03ac89fe21a8d2d-1] hfile.CacheConfig(258): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:52,281 INFO [StoreOpener-98664e5c7a903927b03ac89fe21a8d2d-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:52,286 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d 2017-12-06 22:38:52,298 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:52,299 INFO [RS_OPEN_PRIORITY_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined 98664e5c7a903927b03ac89fe21a8d2d; next sequenceid=2 2017-12-06 22:38:52,303 INFO [PostOpenDeployTasks:98664e5c7a903927b03ac89fe21a8d2d] regionserver.HRegionServer(2204): Post open deploy tasks for hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:52,306 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:52,307 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=4 updating hbase:meta row=hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:52,308 DEBUG [PostOpenDeployTasks:98664e5c7a903927b03ac89fe21a8d2d] regionserver.HRegionServer(2228): Finished post open deploy task for hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:38:52,311 DEBUG [RS_OPEN_PRIORITY_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:52,375 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=4, ppid=3, state=SUCCESS; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d 2017-12-06 22:38:52,408 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=3, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=hbase:namespace; resume parent processing. 2017-12-06 22:38:52,409 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=4, ppid=3, state=SUCCESS; AssignProcedure table=hbase:namespace, region=98664e5c7a903927b03ac89fe21a8d2d in 478msec 2017-12-06 22:38:52,409 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599932409}]},"ts":1512599932409} 2017-12-06 22:38:52,416 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:namespace state to ENABLED in META 2017-12-06 22:38:52,458 DEBUG [asf911:39318.masterManager] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2017-12-06 22:38:52,475 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2017-12-06 22:38:52,557 DEBUG [asf911:39318.masterManager] procedure2.ProcedureExecutor(868): Stored pid=5, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2017-12-06 22:38:52,598 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.4430sec 2017-12-06 22:38:52,784 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2017-12-06 22:38:52,794 DEBUG [main-EventThread] hbase.ZKNamespaceManager(202): Updating namespace cache from node default with data: \x0A\x07default 2017-12-06 22:38:52,890 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 351msec 2017-12-06 22:38:52,956 DEBUG [asf911:39318.masterManager] procedure2.ProcedureExecutor(868): Stored pid=6, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:38:53,126 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2017-12-06 22:38:53,135 DEBUG [main-EventThread] hbase.ZKNamespaceManager(202): Updating namespace cache from node default with data: \x0A\x07default 2017-12-06 22:38:53,136 DEBUG [main-EventThread] hbase.ZKNamespaceManager(202): Updating namespace cache from node hbase with data: \x0A\x05hbase 2017-12-06 22:38:53,290 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 303msec 2017-12-06 22:38:53,300 DEBUG [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(613): Node /hbase/namespace/default already exists 2017-12-06 22:38:53,309 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2017-12-06 22:38:53,317 DEBUG [asf911:39318.masterManager] zookeeper.RecoverableZooKeeper(613): Node /hbase/namespace/hbase already exists 2017-12-06 22:38:53,325 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2017-12-06 22:38:53,326 INFO [asf911:39318.masterManager] master.HMaster(906): Master has completed initialization 7.306sec 2017-12-06 22:38:53,331 INFO [asf911:39318.masterManager] quotas.MasterQuotaManager(81): Quota support disabled 2017-12-06 22:38:53,332 INFO [asf911:39318.masterManager] zookeeper.ZKWatcher(189): not a secure deployment, proceeding 2017-12-06 22:38:53,389 INFO [main] master.HMaster(2488): Client=null/null get ClusterStatus, status=Master: asf911.gq1.ygridcore.net,39318,1512599924553 Number of backup masters: 0 Number of live region servers: 1 asf911.gq1.ygridcore.net,43202,1512599926033 Number of dead region servers: 0 Average load: 2.0 Number of requests: 0 Number of regions: 2 Number of regions in transition: 0, options=[HBASE_VERSION, CLUSTER_ID, BALANCER_ON, LIVE_SERVERS, DEAD_SERVERS, MASTER, BACKUP_MASTERS, MASTER_COPROCESSORS, REGIONS_IN_TRANSITION, MASTER_INFO_PORT] 2017-12-06 22:38:53,391 INFO [main] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x1abebef3 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:38:53,402 DEBUG [main] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f55704, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:38:53,408 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.noKeySetOptimization: false 2017-12-06 22:38:53,408 DEBUG [main] logging.Slf4JLogger(76): -Dio.netty.selectorAutoRebuildThreshold: 512 2017-12-06 22:38:53,421 DEBUG [hconnection-0x4c447c09-shared-pool13-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:38:53,434 DEBUG [RS-EventLoopGroup-3-9] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46382; # active connections: 3 2017-12-06 22:38:53,437 INFO [RS-EventLoopGroup-3-9] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:38:53,438 INFO [RS-EventLoopGroup-3-9] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46382 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:53,444 INFO [main] hbase.HBaseTestingUtility(1029): Minicluster is up 2017-12-06 22:38:53,498 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testTruncateNotDisabledTable Thread=215, OpenFileDescriptor=785, MaxFileDescriptor=60000, SystemLoadAverage=598, ProcessCount=249, AvailableMemoryMB=13120 2017-12-06 22:38:53,504 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:38:53,610 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=7, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:38:53,679 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741834_1010{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 522 2017-12-06 22:38:54,085 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/.tabledesc/.tableinfo.0000000001 2017-12-06 22:38:54,088 INFO [RegionOpenAndInitThread-testTruncateNotDisabledTable-1] regionserver.HRegion(6731): creating HRegion testTruncateNotDisabledTable HTD == 'testTruncateNotDisabledTable', {NAME => 'f', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testTruncateNotDisabledTable 2017-12-06 22:38:54,107 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741835_1011{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 63 2017-12-06 22:38:54,510 DEBUG [RegionOpenAndInitThread-testTruncateNotDisabledTable-1] regionserver.HRegion(799): Instantiated testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:54,512 DEBUG [RegionOpenAndInitThread-testTruncateNotDisabledTable-1] regionserver.HRegion(1471): Closing testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.: disabling compactions & flushes 2017-12-06 22:38:54,512 DEBUG [RegionOpenAndInitThread-testTruncateNotDisabledTable-1] regionserver.HRegion(1510): Updates disabled for region testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:54,512 INFO [RegionOpenAndInitThread-testTruncateNotDisabledTable-1] regionserver.HRegion(1623): Closed testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:54,583 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:38:54,593 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:38:54,631 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testTruncateNotDisabledTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599934631}]},"ts":1512599934631} 2017-12-06 22:38:54,636 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testTruncateNotDisabledTable state to ENABLING in META 2017-12-06 22:38:54,636 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57}] 2017-12-06 22:38:54,702 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57 testTruncateNotDisabledTable testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:54,706 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(135): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2017-12-06 22:38:54,706 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:54,707 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(139): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2017-12-06 22:38:54,858 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=8 updating hbase:meta row=testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:54,860 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:38:54,860 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:38:54,873 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:55,023 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:55,026 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:55,034 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => 16ae9a4c9c9aeb4e00dd8526d08c5b57, NAME => 'testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.', STARTKEY => '', ENDKEY => ''} 2017-12-06 22:38:55,035 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testTruncateNotDisabledTable 16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:38:55,035 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:55,049 DEBUG [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/f 2017-12-06 22:38:55,049 DEBUG [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/f 2017-12-06 22:38:55,052 INFO [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 2684354 2017-12-06 22:38:55,052 INFO [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:55,053 INFO [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] hfile.CacheConfig(258): Created cacheConfig for f: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:55,054 INFO [StoreOpener-16ae9a4c9c9aeb4e00dd8526d08c5b57-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:55,056 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:55,059 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:38:55,063 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testTruncateNotDisabledTable, use config (134217728) instead 2017-12-06 22:38:55,071 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:55,071 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined 16ae9a4c9c9aeb4e00dd8526d08c5b57; next sequenceid=2 2017-12-06 22:38:55,073 INFO [PostOpenDeployTasks:16ae9a4c9c9aeb4e00dd8526d08c5b57] regionserver.HRegionServer(2204): Post open deploy tasks for testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:55,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:55,076 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=8 updating hbase:meta row=testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:55,077 DEBUG [PostOpenDeployTasks:16ae9a4c9c9aeb4e00dd8526d08c5b57] regionserver.HRegionServer(2228): Finished post open deploy task for testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:55,078 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:55,133 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=8, ppid=7, state=SUCCESS; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:38:55,183 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=7, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=testTruncateNotDisabledTable; resume parent processing. 2017-12-06 22:38:55,183 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=8, ppid=7, state=SUCCESS; AssignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57 in 447msec 2017-12-06 22:38:55,184 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testTruncateNotDisabledTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599935184}]},"ts":1512599935184} 2017-12-06 22:38:55,189 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testTruncateNotDisabledTable state to ENABLED in META 2017-12-06 22:38:55,300 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable in 1.7340sec 2017-12-06 22:38:55,435 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=9, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:38:55,661 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1340): Rolled back pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) exec-time=206msec 2017-12-06 22:38:55,686 DEBUG [Time-limited test] procedure.TestTruncateTableProcedure(80): Truncate failed with exception: org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable 2017-12-06 22:38:55,687 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:38:55,702 DEBUG [Time-limited test] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:39318 2017-12-06 22:38:55,708 DEBUG [RS-EventLoopGroup-1-3] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46317; # active connections: 1 2017-12-06 22:38:55,709 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:38:55,710 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46317 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:38:55,736 INFO [Time-limited test] procedure.TestTableDDLProcedureBase(67): Tear down, remove table=testTruncateNotDisabledTable 2017-12-06 22:38:55,739 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testTruncateNotDisabledTable 2017-12-06 22:38:55,747 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testTruncateNotDisabledTable 2017-12-06 22:38:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=10, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:38:55,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=10 2017-12-06 22:38:55,959 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:38:55,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=10 2017-12-06 22:38:56,003 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testTruncateNotDisabledTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599936003}]},"ts":1512599936003} 2017-12-06 22:38:56,009 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testTruncateNotDisabledTable state to DISABLING in META 2017-12-06 22:38:56,049 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:38:56,115 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=11, ppid=10, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033 testTruncateNotDisabledTable testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:56,115 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=11 updating hbase:meta row=testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:56,122 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=11, ppid=10, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:56,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=10 2017-12-06 22:38:56,272 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:56,277 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 16ae9a4c9c9aeb4e00dd8526d08c5b57 without moving 2017-12-06 22:38:56,280 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:56,281 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.: disabling compactions & flushes 2017-12-06 22:38:56,281 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:56,282 INFO [StoreCloserThread-testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.-1] regionserver.HStore(925): Closed f 2017-12-06 22:38:56,297 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits/4.seqid, newSeqId=4, maxSeqId=2 2017-12-06 22:38:56,304 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:56,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=11, ppid=10, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:56,307 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=11 updating hbase:meta row=testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57., regionState=CLOSED 2017-12-06 22:38:56,307 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. 2017-12-06 22:38:56,349 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=11, ppid=10, state=SUCCESS; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:56,395 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=10, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testTruncateNotDisabledTable; resume parent processing. 2017-12-06 22:38:56,396 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=11, ppid=10, state=SUCCESS; UnassignProcedure table=testTruncateNotDisabledTable, region=16ae9a4c9c9aeb4e00dd8526d08c5b57, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 264msec 2017-12-06 22:38:56,396 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testTruncateNotDisabledTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599936396}]},"ts":1512599936396} 2017-12-06 22:38:56,401 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testTruncateNotDisabledTable state to DISABLED in META 2017-12-06 22:38:56,402 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testTruncateNotDisabledTable, is completed. 2017-12-06 22:38:56,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=10 2017-12-06 22:38:56,467 ERROR [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] ipc.RpcServer(464): Unexpected throwable object java.lang.AssertionError: pid=10 is still running at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.removeResult(ProcedureExecutor.java:1012) at org.apache.hadoop.hbase.master.MasterRpcServices.getProcedureResult(MasterRpcServices.java:1155) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:38:56,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] ipc.CallRunner(141): callId: 12 service: MasterService methodName: getProcedureResult size: 34 connection: 67.195.81.155:46317 deadline: 1512599996466 java.io.IOException: pid=10 is still running at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:465) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) Caused by: java.lang.AssertionError: pid=10 is still running at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.removeResult(ProcedureExecutor.java:1012) at org.apache.hadoop.hbase.master.MasterRpcServices.getProcedureResult(MasterRpcServices.java:1155) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) ... 3 more 2017-12-06 22:38:56,496 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable in 705msec 2017-12-06 22:38:56,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=10 2017-12-06 22:38:56,573 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testTruncateNotDisabledTable completed 2017-12-06 22:38:56,582 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.HMaster$5(2101): Client=jenkins//67.195.81.155 delete testTruncateNotDisabledTable 2017-12-06 22:38:56,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=12, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:38:56,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=12 2017-12-06 22:38:56,686 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(99): Waiting for 'testTruncateNotDisabledTable' regions in transition 2017-12-06 22:38:56,737 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(110): delete 'testTruncateNotDisabledTable' regions from META 2017-12-06 22:38:56,738 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599936737}]},"ts":9223372036854775807} 2017-12-06 22:38:56,743 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:38:56,744 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 16ae9a4c9c9aeb4e00dd8526d08c5b57, NAME => 'testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:38:56,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=12 2017-12-06 22:38:56,791 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(115): delete 'testTruncateNotDisabledTable' from filesystem 2017-12-06 22:38:56,800 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57. from FS 2017-12-06 22:38:56,804 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:38:56,815 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/f, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits] 2017-12-06 22:38:56,850 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits/4.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits/4.seqid 2017-12-06 22:38:56,852 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:55766 2017-12-06 22:38:56,854 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:38:56,855 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testTruncateNotDisabledTable' archived! 2017-12-06 22:38:56,857 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:55766 2017-12-06 22:38:56,895 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741834_1010, blk_1073741835_1011] 2017-12-06 22:38:56,916 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(121): delete 'testTruncateNotDisabledTable' descriptor 2017-12-06 22:38:56,916 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(399): Removing 'testTruncateNotDisabledTable' descriptor. 2017-12-06 22:38:56,983 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(126): delete 'testTruncateNotDisabledTable' assignment state 2017-12-06 22:38:56,983 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testTruncateNotDisabledTable' from region states. 2017-12-06 22:38:56,983 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599936983}]},"ts":9223372036854775807} 2017-12-06 22:38:56,990 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:38:56,990 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 16ae9a4c9c9aeb4e00dd8526d08c5b57, NAME => 'testTruncateNotDisabledTable,,1512599933508.16ae9a4c9c9aeb4e00dd8526d08c5b57.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:38:56,990 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testTruncateNotDisabledTable' as deleted. 2017-12-06 22:38:56,990 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testTruncateNotDisabledTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599936990}]},"ts":9223372036854775807} 2017-12-06 22:38:56,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=12 2017-12-06 22:38:56,997 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testTruncateNotDisabledTable state from META 2017-12-06 22:38:57,062 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(132): delete 'testTruncateNotDisabledTable' completed 2017-12-06 22:38:57,133 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable in 476msec 2017-12-06 22:38:57,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=12 2017-12-06 22:38:57,300 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DELETE, Table Name: default:testTruncateNotDisabledTable completed 2017-12-06 22:38:57,336 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testTruncateNotDisabledTable Thread=224 (was 215) Potentially hanging thread: RSProcedureDispatcher-pool4-t4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_CLOSE_REGION-asf911:43202-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Default-IPC-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.hbase.shaded.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hadoop.hbase.shaded.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:752) org.apache.hadoop.hbase.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:408) org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.Native.epollWait(Native.java:111) org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:230) org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:254) org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_OPEN_REGION-asf911:43202-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-952941535_1 at /127.0.0.1:37425 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:229) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=790 (was 785) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=558 (was 598), ProcessCount=250 (was 249) - ProcessCount LEAK? -, AvailableMemoryMB=13104 (was 13120) 2017-12-06 22:38:57,358 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testSimpleTruncateNoPreserveSplits Thread=224, OpenFileDescriptor=790, MaxFileDescriptor=60000, SystemLoadAverage=558, ProcessCount=250, AvailableMemoryMB=13104 2017-12-06 22:38:57,359 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:38:57,440 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=13, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:38:57,532 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741836_1012{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 989 2017-12-06 22:38:57,940 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:38:57,944 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testSimpleTruncateNoPreserveSplits HTD == 'testSimpleTruncateNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncateNoPreserveSplits 2017-12-06 22:38:57,944 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-4] regionserver.HRegion(6731): creating HRegion testSimpleTruncateNoPreserveSplits HTD == 'testSimpleTruncateNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncateNoPreserveSplits 2017-12-06 22:38:57,945 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-3] regionserver.HRegion(6731): creating HRegion testSimpleTruncateNoPreserveSplits HTD == 'testSimpleTruncateNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncateNoPreserveSplits 2017-12-06 22:38:57,947 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-2] regionserver.HRegion(6731): creating HRegion testSimpleTruncateNoPreserveSplits HTD == 'testSimpleTruncateNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncateNoPreserveSplits 2017-12-06 22:38:57,990 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741837_1013{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 71 2017-12-06 22:38:57,991 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741839_1015{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 71 2017-12-06 22:38:57,993 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741838_1014{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 70 2017-12-06 22:38:57,996 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741840_1016{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 70 2017-12-06 22:38:58,521 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-4] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:58,522 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-3] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:58,522 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-4] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.: disabling compactions & flushes 2017-12-06 22:38:58,522 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:58,522 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-4] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:58,522 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-2] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:58,521 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:58,523 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-2] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.: disabling compactions & flushes 2017-12-06 22:38:58,522 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-3] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.: disabling compactions & flushes 2017-12-06 22:38:58,523 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:58,523 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-3] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:58,523 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:58,523 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.: disabling compactions & flushes 2017-12-06 22:38:58,524 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-2] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:58,524 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:58,524 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:58,861 WARN [DataXceiver for client DFSClient_NONMAPREDUCE_-1064546853_1 at /127.0.0.1:37348 [Receiving block BP-109774452-67.195.81.155-1512599919954:blk_1073741829_1005]] datanode.BlockReceiver(422): Slow flushOrSync took 331ms (threshold=300ms), isSync:true, flushTotalNanos=11119ns 2017-12-06 22:38:58,865 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:38:58,871 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:38:58,970 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599938970}]},"ts":1512599938970} 2017-12-06 22:38:58,975 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to ENABLING in META 2017-12-06 22:38:58,975 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398}, {pid=15, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79}, {pid=16, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098}, {pid=17, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8}] 2017-12-06 22:38:59,030 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=17, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,033 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=17, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:59,092 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=16, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,095 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=16, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:59,146 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=15, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,149 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=15, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:59,180 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=14, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,182 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=14, ppid=13, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:38:59,213 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=14 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,228 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=14, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,284 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=15 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,291 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=15, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,334 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=16 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,339 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=16, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,378 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:59,381 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,384 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=17 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,389 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,389 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => fa1e4268b5393156c1b54ef4624e3098, NAME => 'testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => 5707781f5e2aace24e68cf1e95aa3a79, NAME => 'testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.', STARTKEY => 'b', ENDKEY => 'c'} 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => 645e3955239c612f4345ca54c742f398, NAME => 'testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.', STARTKEY => 'c', ENDKEY => ''} 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncateNoPreserveSplits 5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncateNoPreserveSplits 645e3955239c612f4345ca54c742f398 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncateNoPreserveSplits fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:38:59,391 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=17, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,391 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,390 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,394 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,403 DEBUG [StoreOpener-645e3955239c612f4345ca54c742f398-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:38:59,403 DEBUG [StoreOpener-645e3955239c612f4345ca54c742f398-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:38:59,404 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,405 DEBUG [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:38:59,405 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,405 DEBUG [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:38:59,406 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,406 DEBUG [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:38:59,406 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,406 DEBUG [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:38:59,407 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,407 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,407 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,407 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,408 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,408 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,409 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,410 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,417 DEBUG [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:38:59,419 DEBUG [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:38:59,419 DEBUG [StoreOpener-645e3955239c612f4345ca54c742f398-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:38:59,420 DEBUG [StoreOpener-645e3955239c612f4345ca54c742f398-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:38:59,419 DEBUG [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:38:59,420 DEBUG [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:38:59,420 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,420 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,420 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,421 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,420 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,420 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,421 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,421 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,421 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,423 INFO [StoreOpener-5707781f5e2aace24e68cf1e95aa3a79-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,424 INFO [StoreOpener-fa1e4268b5393156c1b54ef4624e3098-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,424 INFO [StoreOpener-645e3955239c612f4345ca54c742f398-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,428 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,428 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,428 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,430 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:38:59,430 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:38:59,430 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:38:59,433 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncateNoPreserveSplits, use config (67108864) instead 2017-12-06 22:38:59,434 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncateNoPreserveSplits, use config (67108864) instead 2017-12-06 22:38:59,434 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncateNoPreserveSplits, use config (67108864) instead 2017-12-06 22:38:59,439 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:59,439 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined 645e3955239c612f4345ca54c742f398; next sequenceid=2 2017-12-06 22:38:59,440 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:59,440 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined fa1e4268b5393156c1b54ef4624e3098; next sequenceid=2 2017-12-06 22:38:59,441 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:59,441 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined 5707781f5e2aace24e68cf1e95aa3a79; next sequenceid=2 2017-12-06 22:38:59,441 INFO [PostOpenDeployTasks:645e3955239c612f4345ca54c742f398] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,442 INFO [PostOpenDeployTasks:fa1e4268b5393156c1b54ef4624e3098] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,444 INFO [PostOpenDeployTasks:5707781f5e2aace24e68cf1e95aa3a79] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=14, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=16, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,445 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=14 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,445 DEBUG [PostOpenDeployTasks:645e3955239c612f4345ca54c742f398] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:38:59,446 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=15, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,448 DEBUG [PostOpenDeployTasks:fa1e4268b5393156c1b54ef4624e3098] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:38:59,449 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,449 DEBUG [PostOpenDeployTasks:5707781f5e2aace24e68cf1e95aa3a79] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:38:59,450 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,496 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=14, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398 2017-12-06 22:38:59,497 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=14, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398 in 478msec 2017-12-06 22:38:59,497 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=15 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,542 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=15, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:38:59,542 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=15, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79 in 528msec 2017-12-06 22:38:59,543 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=16 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,544 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:38:59,546 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,553 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => ed4335ddaae62ee3b1bd6b1510661cf8, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.', STARTKEY => '', ENDKEY => 'a'} 2017-12-06 22:38:59,553 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncateNoPreserveSplits ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:38:59,553 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,561 DEBUG [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:38:59,561 DEBUG [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:38:59,561 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,561 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,562 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,562 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,569 DEBUG [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:38:59,569 DEBUG [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:38:59,570 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:38:59,570 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:38:59,570 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:38:59,570 INFO [StoreOpener-ed4335ddaae62ee3b1bd6b1510661cf8-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:38:59,573 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,575 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:38:59,578 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncateNoPreserveSplits, use config (67108864) instead 2017-12-06 22:38:59,580 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=16, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:38:59,580 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=16, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098 in 572msec 2017-12-06 22:38:59,584 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:38:59,584 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined ed4335ddaae62ee3b1bd6b1510661cf8; next sequenceid=2 2017-12-06 22:38:59,585 INFO [PostOpenDeployTasks:ed4335ddaae62ee3b1bd6b1510661cf8] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=17, ppid=13, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,588 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=17 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,588 DEBUG [PostOpenDeployTasks:ed4335ddaae62ee3b1bd6b1510661cf8] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:38:59,589 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:38:59,630 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=17, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:38:59,692 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=13, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits; resume parent processing. 2017-12-06 22:38:59,692 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=17, ppid=13, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8 in 619msec 2017-12-06 22:38:59,693 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599939693}]},"ts":1512599939693} 2017-12-06 22:38:59,699 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to ENABLED in META 2017-12-06 22:38:59,861 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits in 2.4460sec 2017-12-06 22:39:00,006 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:00,015 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:00,017 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:00,021 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:00,044 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:39:00,048 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:39:00,052 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:39:00,062 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:00,063 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:00,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=18, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:00,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:00,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:00,232 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599940231}]},"ts":1512599940231} 2017-12-06 22:39:00,237 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to DISABLING in META 2017-12-06 22:39:00,299 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=20, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=21, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=22, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:00,381 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=22, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:39:00,382 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=22 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,387 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=22, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:00,440 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=21, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:39:00,440 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=21 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,445 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=21, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,478 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=20, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:39:00,478 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=20 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,483 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=20, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,523 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=19, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:39:00,523 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=19 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,526 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=19, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:00,538 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:00,539 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close ed4335ddaae62ee3b1bd6b1510661cf8 without moving 2017-12-06 22:39:00,540 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close fa1e4268b5393156c1b54ef4624e3098 without moving 2017-12-06 22:39:00,540 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:39:00,542 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 5707781f5e2aace24e68cf1e95aa3a79 without moving 2017-12-06 22:39:00,542 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:39:00,542 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 645e3955239c612f4345ca54c742f398 without moving 2017-12-06 22:39:00,542 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:39:00,543 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.: disabling compactions & flushes 2017-12-06 22:39:00,543 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.: disabling compactions & flushes 2017-12-06 22:39:00,544 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:39:00,546 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=7.46 KB 2017-12-06 22:39:00,544 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:39:00,546 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=666 B 2017-12-06 22:39:00,544 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.: disabling compactions & flushes 2017-12-06 22:39:00,546 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:39:00,546 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=1.30 KB 2017-12-06 22:39:00,558 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.store: f1 2017-12-06 22:39:00,558 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.store: f1 2017-12-06 22:39:00,558 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.store: f1 2017-12-06 22:39:00,559 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,559 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,559 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,560 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.store: f2 2017-12-06 22:39:00,561 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.store: f2 2017-12-06 22:39:00,561 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.store: f2 2017-12-06 22:39:00,561 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,561 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,561 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:00,649 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741841_1017{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5260 2017-12-06 22:39:00,650 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741842_1018{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5608 2017-12-06 22:39:00,650 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741843_1019{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 8918 2017-12-06 22:39:00,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:00,867 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:39:01,051 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=668, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/.tmp/f1/d3429c5796bd4176b612056fdc0a0f0b 2017-12-06 22:39:01,051 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/.tmp/f1/9c86272321f04a12aea8e363083081ad 2017-12-06 22:39:01,053 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=3.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/.tmp/f1/27585d74d4a44ae4bd4ac2bb92e8975f 2017-12-06 22:39:01,158 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|FINALIZED]]} size 0 2017-12-06 22:39:01,163 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/.tmp/f2/52f27716b1fd4d15997054d0963e163b 2017-12-06 22:39:01,167 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741845_1021{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5608 2017-12-06 22:39:01,168 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741846_1022{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 8918 2017-12-06 22:39:01,182 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/.tmp/f1/9c86272321f04a12aea8e363083081ad as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1/9c86272321f04a12aea8e363083081ad 2017-12-06 22:39:01,197 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1/9c86272321f04a12aea8e363083081ad, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:01,206 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/.tmp/f2/52f27716b1fd4d15997054d0963e163b as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2/52f27716b1fd4d15997054d0963e163b 2017-12-06 22:39:01,219 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2/52f27716b1fd4d15997054d0963e163b, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:01,221 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~666 B/666, currentsize=0 B/0 for region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. in 675ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:01,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:01,227 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:01,228 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:01,237 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:01,238 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:39:01,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=20, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,240 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=20 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098., regionState=CLOSED 2017-12-06 22:39:01,240 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. 2017-12-06 22:39:01,240 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:39:01,241 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.: disabling compactions & flushes 2017-12-06 22:39:01,242 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:39:01,242 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=3.66 KB 2017-12-06 22:39:01,242 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.store: f1 2017-12-06 22:39:01,243 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:01,243 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.store: f2 2017-12-06 22:39:01,243 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:01,285 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741847_1023{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 6880 2017-12-06 22:39:01,298 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=20, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,298 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=20, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=fa1e4268b5393156c1b54ef4624e3098, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 947msec 2017-12-06 22:39:01,569 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=668, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/.tmp/f2/fc87dae54f244209aceeb07080edeb3d 2017-12-06 22:39:01,572 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=3.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/.tmp/f2/2976f5086a19427f80e77fcb45034b59 2017-12-06 22:39:01,590 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/.tmp/f1/27585d74d4a44ae4bd4ac2bb92e8975f as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1/27585d74d4a44ae4bd4ac2bb92e8975f 2017-12-06 22:39:01,592 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/.tmp/f1/d3429c5796bd4176b612056fdc0a0f0b as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1/d3429c5796bd4176b612056fdc0a0f0b 2017-12-06 22:39:01,608 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1/27585d74d4a44ae4bd4ac2bb92e8975f, entries=57, sequenceid=5, filesize=8.7 K 2017-12-06 22:39:01,611 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1/d3429c5796bd4176b612056fdc0a0f0b, entries=10, sequenceid=5, filesize=5.5 K 2017-12-06 22:39:01,615 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/.tmp/f2/2976f5086a19427f80e77fcb45034b59 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2/2976f5086a19427f80e77fcb45034b59 2017-12-06 22:39:01,615 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/.tmp/f2/fc87dae54f244209aceeb07080edeb3d as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2/fc87dae54f244209aceeb07080edeb3d 2017-12-06 22:39:01,628 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2/2976f5086a19427f80e77fcb45034b59, entries=57, sequenceid=5, filesize=8.7 K 2017-12-06 22:39:01,628 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2/fc87dae54f244209aceeb07080edeb3d, entries=10, sequenceid=5, filesize=5.5 K 2017-12-06 22:39:01,630 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~1.30 KB/1336, currentsize=0 B/0 for region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. in 1084ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:01,630 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~7.46 KB/7638, currentsize=0 B/0 for region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. in 1085ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:01,633 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:01,633 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:01,634 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:01,635 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:01,644 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:01,644 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:01,646 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:39:01,646 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:39:01,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=19, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=21, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,649 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=19 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8., regionState=CLOSED 2017-12-06 22:39:01,649 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. 2017-12-06 22:39:01,649 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. 2017-12-06 22:39:01,687 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/.tmp/f1/ffd1a01fc6da4af59cfde00e24709c75 2017-12-06 22:39:01,711 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=19, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,711 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=19, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=ed4335ddaae62ee3b1bd6b1510661cf8, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.3580sec 2017-12-06 22:39:01,712 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=21 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79., regionState=CLOSED 2017-12-06 22:39:01,722 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741848_1024{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 6880 2017-12-06 22:39:01,786 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=21, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:01,787 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=21, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=5707781f5e2aace24e68cf1e95aa3a79, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.4210sec 2017-12-06 22:39:01,805 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:02,125 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/.tmp/f2/2489c7bfc0124feca15a52b8faf88ed1 2017-12-06 22:39:02,143 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/.tmp/f1/ffd1a01fc6da4af59cfde00e24709c75 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1/ffd1a01fc6da4af59cfde00e24709c75 2017-12-06 22:39:02,158 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1/ffd1a01fc6da4af59cfde00e24709c75, entries=28, sequenceid=5, filesize=6.7 K 2017-12-06 22:39:02,160 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/.tmp/f2/2489c7bfc0124feca15a52b8faf88ed1 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2/2489c7bfc0124feca15a52b8faf88ed1 2017-12-06 22:39:02,171 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2/2489c7bfc0124feca15a52b8faf88ed1, entries=28, sequenceid=5, filesize=6.7 K 2017-12-06 22:39:02,174 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~3.66 KB/3748, currentsize=0 B/0 for region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. in 932ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:02,177 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:02,178 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:02,189 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:02,191 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:39:02,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=22, ppid=18, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:02,193 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=22 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398., regionState=CLOSED 2017-12-06 22:39:02,193 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. 2017-12-06 22:39:02,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:02,248 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=22, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:02,286 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=18, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits; resume parent processing. 2017-12-06 22:39:02,286 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=22, ppid=18, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=645e3955239c612f4345ca54c742f398, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.9010sec 2017-12-06 22:39:02,287 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599942287}]},"ts":1512599942287} 2017-12-06 22:39:02,292 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to DISABLED in META 2017-12-06 22:39:02,292 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testSimpleTruncateNoPreserveSplits, is completed. 2017-12-06 22:39:02,404 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits in 2.3010sec 2017-12-06 22:39:04,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=18 2017-12-06 22:39:04,235 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testSimpleTruncateNoPreserveSplits completed 2017-12-06 22:39:04,321 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=23, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:04,327 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testSimpleTruncateNoPreserveSplits' regions in transition 2017-12-06 22:39:04,408 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944408}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944408}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944408}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944408}]},"ts":9223372036854775807} 2017-12-06 22:39:04,414 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:04,414 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => ed4335ddaae62ee3b1bd6b1510661cf8, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => fa1e4268b5393156c1b54ef4624e3098, NAME => 'testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => 5707781f5e2aace24e68cf1e95aa3a79, NAME => 'testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 645e3955239c612f4345ca54c742f398, NAME => 'testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:04,420 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testSimpleTruncateNoPreserveSplits' from region states. 2017-12-06 22:39:04,421 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944421}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944421}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944421}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599944421}]},"ts":9223372036854775807} 2017-12-06 22:39:04,429 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:04,430 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => ed4335ddaae62ee3b1bd6b1510661cf8, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => fa1e4268b5393156c1b54ef4624e3098, NAME => 'testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => 5707781f5e2aace24e68cf1e95aa3a79, NAME => 'testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 645e3955239c612f4345ca54c742f398, NAME => 'testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:04,430 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testSimpleTruncateNoPreserveSplits' as deleted. 2017-12-06 22:39:04,430 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599944430}]},"ts":9223372036854775807} 2017-12-06 22:39:04,434 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testSimpleTruncateNoPreserveSplits state from META 2017-12-06 22:39:04,505 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. from FS 2017-12-06 22:39:04,505 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:04,512 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits] 2017-12-06 22:39:04,537 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1/27585d74d4a44ae4bd4ac2bb92e8975f, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1/27585d74d4a44ae4bd4ac2bb92e8975f 2017-12-06 22:39:04,546 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2/2976f5086a19427f80e77fcb45034b59, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2/2976f5086a19427f80e77fcb45034b59 2017-12-06 22:39:04,555 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits/8.seqid 2017-12-06 22:39:04,556 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:55766 2017-12-06 22:39:04,557 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:04,557 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncateNoPreserveSplits,a,1512599937362.fa1e4268b5393156c1b54ef4624e3098. from FS 2017-12-06 22:39:04,557 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:04,564 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits] 2017-12-06 22:39:04,575 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1/9c86272321f04a12aea8e363083081ad, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1/9c86272321f04a12aea8e363083081ad 2017-12-06 22:39:04,584 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2/52f27716b1fd4d15997054d0963e163b, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2/52f27716b1fd4d15997054d0963e163b 2017-12-06 22:39:04,592 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits/8.seqid 2017-12-06 22:39:04,593 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741839_1015 127.0.0.1:55766 2017-12-06 22:39:04,594 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:04,594 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncateNoPreserveSplits,b,1512599937362.5707781f5e2aace24e68cf1e95aa3a79. from FS 2017-12-06 22:39:04,594 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:04,600 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits] 2017-12-06 22:39:04,609 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1/d3429c5796bd4176b612056fdc0a0f0b, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1/d3429c5796bd4176b612056fdc0a0f0b 2017-12-06 22:39:04,618 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2/fc87dae54f244209aceeb07080edeb3d, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2/fc87dae54f244209aceeb07080edeb3d 2017-12-06 22:39:04,626 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits/8.seqid 2017-12-06 22:39:04,627 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:55766 2017-12-06 22:39:04,628 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:04,628 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncateNoPreserveSplits,c,1512599937362.645e3955239c612f4345ca54c742f398. from FS 2017-12-06 22:39:04,628 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:04,634 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits] 2017-12-06 22:39:04,644 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1/ffd1a01fc6da4af59cfde00e24709c75, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1/ffd1a01fc6da4af59cfde00e24709c75 2017-12-06 22:39:04,660 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2/2489c7bfc0124feca15a52b8faf88ed1, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2/2489c7bfc0124feca15a52b8faf88ed1 2017-12-06 22:39:04,669 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits/8.seqid 2017-12-06 22:39:04,670 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:55766 2017-12-06 22:39:04,670 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:04,671 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testSimpleTruncateNoPreserveSplits' archived! 2017-12-06 22:39:04,672 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:55766 2017-12-06 22:39:04,766 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741849_1025{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 989 2017-12-06 22:39:05,169 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:05,172 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testSimpleTruncateNoPreserveSplits HTD == 'testSimpleTruncateNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:05,201 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741850_1026{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 69 2017-12-06 22:39:05,603 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:05,604 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.: disabling compactions & flushes 2017-12-06 22:39:05,604 DEBUG [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:05,604 INFO [RegionOpenAndInitThread-testSimpleTruncateNoPreserveSplits-1] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:05,653 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:05,657 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:39:05,693 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599945693}]},"ts":1512599945693} 2017-12-06 22:39:05,697 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to ENABLING in META 2017-12-06 22:39:05,697 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f}] 2017-12-06 22:39:05,768 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=24, ppid=23, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:05,771 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=24, ppid=23, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:05,896 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741840_1016, blk_1073741836_1012, blk_1073741837_1013, blk_1073741838_1014, blk_1073741839_1015] 2017-12-06 22:39:05,923 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=24 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:05,928 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=24, ppid=23, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:06,079 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:06,082 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,089 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => 6112de920b0f89fee9cdf717b720b96f, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.', STARTKEY => '', ENDKEY => ''} 2017-12-06 22:39:06,090 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncateNoPreserveSplits 6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:06,090 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,097 DEBUG [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:06,097 DEBUG [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:06,097 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:06,097 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:06,098 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:06,098 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:06,103 DEBUG [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:06,103 DEBUG [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:06,104 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:06,104 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:06,104 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:06,105 INFO [StoreOpener-6112de920b0f89fee9cdf717b720b96f-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:06,106 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,107 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:06,109 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncateNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:06,120 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:06,121 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined 6112de920b0f89fee9cdf717b720b96f; next sequenceid=2 2017-12-06 22:39:06,122 INFO [PostOpenDeployTasks:6112de920b0f89fee9cdf717b720b96f] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=24, ppid=23, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:06,127 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=24 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:06,128 DEBUG [PostOpenDeployTasks:6112de920b0f89fee9cdf717b720b96f] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,130 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:06,193 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=24, ppid=23, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:06,260 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=23, state=RUNNABLE:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false); resume parent processing. 2017-12-06 22:39:06,260 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=24, ppid=23, state=SUCCESS; AssignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f in 441msec 2017-12-06 22:39:06,261 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599946261}]},"ts":1512599946261} 2017-12-06 22:39:06,267 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:06,268 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(134): truncate 'testSimpleTruncateNoPreserveSplits' completed 2017-12-06 22:39:06,313 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) in 2.0330sec 2017-12-06 22:39:06,326 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:39:06,342 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:39:06,351 DEBUG [Time-limited test] util.CommonFSUtils(736): Current file system: 2017-12-06 22:39:06,353 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tabledesc/ 2017-12-06 22:39:06,354 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.tableinfo.0000000001 2017-12-06 22:39:06,355 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tmp/ 2017-12-06 22:39:06,356 DEBUG [Time-limited test] util.CommonFSUtils(754): |-6112de920b0f89fee9cdf717b720b96f/ 2017-12-06 22:39:06,361 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:39:06,361 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:39:06,361 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:39:06,362 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:39:06,363 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:39:06,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 52 service: ClientService methodName: Scan size: 139 connection: 67.195.81.155:46382 deadline: 1512600006389 org.apache.hadoop.hbase.NotServingRegionException: testSimpleTruncateNoPreserveSplits,,1512599937362.ed4335ddaae62ee3b1bd6b1510661cf8. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:39:06,580 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:06,727 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:06,737 INFO [Time-limited test] procedure.TestTableDDLProcedureBase(67): Tear down, remove table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:06,739 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:06,740 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:06,743 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:06,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=25, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:06,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:06,884 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599946884}]},"ts":1512599946884} 2017-12-06 22:39:06,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:06,891 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to DISABLING in META 2017-12-06 22:39:06,934 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:06,979 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=26, ppid=25, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncateNoPreserveSplits testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:06,980 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=26 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:06,992 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=26, ppid=25, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:07,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:07,143 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:07,144 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 6112de920b0f89fee9cdf717b720b96f without moving 2017-12-06 22:39:07,145 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:07,146 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.: disabling compactions & flushes 2017-12-06 22:39:07,146 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:07,146 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=6.53 KB 2017-12-06 22:39:07,147 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.store: f1 2017-12-06 22:39:07,147 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:07,147 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.store: f2 2017-12-06 22:39:07,148 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:07,179 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741851_1027{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:39:07,182 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=6, memsize=3.3 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/.tmp/f1/2e0c4f76274e4b8ea22ed459227ad8ec 2017-12-06 22:39:07,239 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741852_1028{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 8372 2017-12-06 22:39:07,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:07,641 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=6, memsize=3.3 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/.tmp/f2/710c0204c5254b7f884dbcc856bae4d6 2017-12-06 22:39:07,661 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/.tmp/f1/2e0c4f76274e4b8ea22ed459227ad8ec as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1/2e0c4f76274e4b8ea22ed459227ad8ec 2017-12-06 22:39:07,675 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1/2e0c4f76274e4b8ea22ed459227ad8ec, entries=50, sequenceid=6, filesize=8.2 K 2017-12-06 22:39:07,682 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/.tmp/f2/710c0204c5254b7f884dbcc856bae4d6 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2/710c0204c5254b7f884dbcc856bae4d6 2017-12-06 22:39:07,693 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2/710c0204c5254b7f884dbcc856bae4d6, entries=50, sequenceid=6, filesize=8.2 K 2017-12-06 22:39:07,696 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~6.53 KB/6688, currentsize=0 B/0 for region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. in 549ms, sequenceid=6, compaction requested=false 2017-12-06 22:39:07,698 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:07,699 INFO [StoreCloserThread-testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:07,709 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits/9.seqid, newSeqId=9, maxSeqId=2 2017-12-06 22:39:07,712 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:07,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=26, ppid=25, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:07,714 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=26 updating hbase:meta row=testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f., regionState=CLOSED 2017-12-06 22:39:07,715 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. 2017-12-06 22:39:07,763 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=26, ppid=25, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:07,813 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=25, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits; resume parent processing. 2017-12-06 22:39:07,813 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=26, ppid=25, state=SUCCESS; UnassignProcedure table=testSimpleTruncateNoPreserveSplits, region=6112de920b0f89fee9cdf717b720b96f, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 786msec 2017-12-06 22:39:07,814 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599947813}]},"ts":1512599947813} 2017-12-06 22:39:07,818 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncateNoPreserveSplits state to DISABLED in META 2017-12-06 22:39:07,818 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testSimpleTruncateNoPreserveSplits, is completed. 2017-12-06 22:39:07,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:07,901 ERROR [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] ipc.RpcServer(464): Unexpected throwable object java.lang.AssertionError: pid=25 is still running at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.removeResult(ProcedureExecutor.java:1012) at org.apache.hadoop.hbase.master.MasterRpcServices.getProcedureResult(MasterRpcServices.java:1155) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:39:07,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] ipc.CallRunner(141): callId: 72 service: MasterService methodName: getProcedureResult size: 34 connection: 67.195.81.155:46317 deadline: 1512600007901 java.io.IOException: pid=25 is still running at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:465) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) Caused by: java.lang.AssertionError: pid=25 is still running at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.removeResult(ProcedureExecutor.java:1012) at org.apache.hadoop.hbase.master.MasterRpcServices.getProcedureResult(MasterRpcServices.java:1155) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) ... 3 more 2017-12-06 22:39:07,942 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits in 1.1440sec 2017-12-06 22:39:08,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=25 2017-12-06 22:39:08,005 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testSimpleTruncateNoPreserveSplits completed 2017-12-06 22:39:08,007 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.HMaster$5(2101): Client=jenkins//67.195.81.155 delete testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:08,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=27, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:08,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=27 2017-12-06 22:39:08,073 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(99): Waiting for 'testSimpleTruncateNoPreserveSplits' regions in transition 2017-12-06 22:39:08,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=27 2017-12-06 22:39:08,176 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(110): delete 'testSimpleTruncateNoPreserveSplits' regions from META 2017-12-06 22:39:08,176 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599948176}]},"ts":9223372036854775807} 2017-12-06 22:39:08,180 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:39:08,180 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 6112de920b0f89fee9cdf717b720b96f, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:39:08,251 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(115): delete 'testSimpleTruncateNoPreserveSplits' from filesystem 2017-12-06 22:39:08,256 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f. from FS 2017-12-06 22:39:08,257 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:08,262 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits] 2017-12-06 22:39:08,272 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1/2e0c4f76274e4b8ea22ed459227ad8ec, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1/2e0c4f76274e4b8ea22ed459227ad8ec 2017-12-06 22:39:08,279 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2/710c0204c5254b7f884dbcc856bae4d6, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2/710c0204c5254b7f884dbcc856bae4d6 2017-12-06 22:39:08,288 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits/9.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits/9.seqid 2017-12-06 22:39:08,289 INFO [IPC Server handler 8 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741850_1026 127.0.0.1:55766 2017-12-06 22:39:08,289 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:08,289 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testSimpleTruncateNoPreserveSplits' archived! 2017-12-06 22:39:08,291 INFO [IPC Server handler 1 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741849_1025 127.0.0.1:55766 2017-12-06 22:39:08,343 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(121): delete 'testSimpleTruncateNoPreserveSplits' descriptor 2017-12-06 22:39:08,343 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(399): Removing 'testSimpleTruncateNoPreserveSplits' descriptor. 2017-12-06 22:39:08,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=27 2017-12-06 22:39:08,385 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(126): delete 'testSimpleTruncateNoPreserveSplits' assignment state 2017-12-06 22:39:08,385 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testSimpleTruncateNoPreserveSplits' from region states. 2017-12-06 22:39:08,385 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599948385}]},"ts":9223372036854775807} 2017-12-06 22:39:08,390 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:39:08,390 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 6112de920b0f89fee9cdf717b720b96f, NAME => 'testSimpleTruncateNoPreserveSplits,,1512599944673.6112de920b0f89fee9cdf717b720b96f.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:39:08,390 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testSimpleTruncateNoPreserveSplits' as deleted. 2017-12-06 22:39:08,391 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncateNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599948391}]},"ts":9223372036854775807} 2017-12-06 22:39:08,394 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testSimpleTruncateNoPreserveSplits state from META 2017-12-06 22:39:08,476 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(132): delete 'testSimpleTruncateNoPreserveSplits' completed 2017-12-06 22:39:08,543 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits in 470msec 2017-12-06 22:39:08,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=27 2017-12-06 22:39:08,680 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DELETE, Table Name: default:testSimpleTruncateNoPreserveSplits completed 2017-12-06 22:39:08,701 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testSimpleTruncateNoPreserveSplits Thread=262 (was 224) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_CLOSE_REGION-asf911:43202-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_OPEN_REGION-asf911:43202-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: htable-pool16-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x4c447c09-shared-pool13-t9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_OPEN_REGION-asf911:43202-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RS_CLOSE_REGION-asf911:43202-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1853331119_1 at /127.0.0.1:37598 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:229) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x4c447c09-shared-pool13-t6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x4c447c09-metaLookup-shared--pool15-t5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: htable-pool14-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x4c447c09-shared-pool13-t8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: RSProcedureDispatcher-pool4-t9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x4c447c09-shared-pool13-t7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: hconnection-0x62050c2d-shared-pool8-t33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: MultiHConnection-shared--pool9-t10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=802 (was 790) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=623 (was 558) - SystemLoadAverage LEAK? -, ProcessCount=249 (was 250), AvailableMemoryMB=12857 (was 13104) 2017-12-06 22:39:08,721 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testTruncateNotExistentTable Thread=261, OpenFileDescriptor=802, MaxFileDescriptor=60000, SystemLoadAverage=623, ProcessCount=249, AvailableMemoryMB=12856 2017-12-06 22:39:08,721 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:08,784 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=28, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:08,897 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741849_1025, blk_1073741850_1026] 2017-12-06 22:39:08,913 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1340): Rolled back pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) exec-time=120msec 2017-12-06 22:39:09,035 DEBUG [Time-limited test] procedure.TestTruncateTableProcedure(63): Truncate failed with exception: org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable 2017-12-06 22:39:09,038 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:09,063 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testTruncateNotExistentTable Thread=261 (was 261), OpenFileDescriptor=802 (was 802), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=623 (was 623), ProcessCount=249 (was 249), AvailableMemoryMB=12851 (was 12856) 2017-12-06 22:39:09,084 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testRecoveryAndDoubleExecutionNoPreserveSplits Thread=261, OpenFileDescriptor=802, MaxFileDescriptor=60000, SystemLoadAverage=623, ProcessCount=249, AvailableMemoryMB=12868 2017-12-06 22:39:09,085 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:09,135 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=29, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:09,237 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741853_1029{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 1001 2017-12-06 22:39:09,641 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:09,645 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-3] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:09,647 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-4] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:09,648 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:09,651 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-2] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:09,673 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741855_1031{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 82 2017-12-06 22:39:09,674 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741854_1030{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 83 2017-12-06 22:39:09,678 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741856_1032{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 82 2017-12-06 22:39:09,678 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741857_1033{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 83 2017-12-06 22:39:10,075 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-3] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,075 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-4] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,076 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-3] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.: disabling compactions & flushes 2017-12-06 22:39:10,076 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,076 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-4] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.: disabling compactions & flushes 2017-12-06 22:39:10,076 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,077 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-4] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,076 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-3] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,079 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,079 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.: disabling compactions & flushes 2017-12-06 22:39:10,079 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,080 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,079 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,080 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.: disabling compactions & flushes 2017-12-06 22:39:10,080 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,080 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,130 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.","families":{"info":[{"qualifier":"regioninfo","vlen":81,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.","families":{"info":[{"qualifier":"regioninfo","vlen":81,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:10,136 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:39:10,186 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599950186}]},"ts":1512599950186} 2017-12-06 22:39:10,190 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLING in META 2017-12-06 22:39:10,190 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7}, {pid=31, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c}, {pid=32, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff}, {pid=33, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686}] 2017-12-06 22:39:10,268 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=33, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,271 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=33, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:10,320 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=32, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,323 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=32, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:10,370 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=31, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,372 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=31, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:10,420 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=30, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,424 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=30, ppid=29, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:10,476 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=31 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,487 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=31, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,537 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=33 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,542 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=33, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,595 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=30 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,600 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=30, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,637 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:10,640 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,645 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,645 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,645 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => f70e6c2f25c41dd4451000859071a3f7, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.', STARTKEY => 'b', ENDKEY => 'c'} 2017-12-06 22:39:10,646 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => cc9fa787e9e90dda082801b829751686, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:39:10,646 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => a80c1bbbdf4887e2b3f39a590baf773c, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.', STARTKEY => 'c', ENDKEY => ''} 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionNoPreserveSplits f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionNoPreserveSplits cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionNoPreserveSplits a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,647 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,653 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=32 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,654 DEBUG [StoreOpener-cc9fa787e9e90dda082801b829751686-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:10,654 DEBUG [StoreOpener-cc9fa787e9e90dda082801b829751686-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:10,654 DEBUG [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:10,654 DEBUG [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:10,654 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,655 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,654 DEBUG [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:10,655 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,655 DEBUG [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:10,655 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,656 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,656 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,656 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,656 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,656 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,657 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,656 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,658 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,659 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=32, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,662 DEBUG [StoreOpener-cc9fa787e9e90dda082801b829751686-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:10,662 DEBUG [StoreOpener-cc9fa787e9e90dda082801b829751686-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:10,663 DEBUG [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:10,663 DEBUG [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:10,663 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,663 DEBUG [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:10,663 DEBUG [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:10,663 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,663 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,663 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,664 INFO [StoreOpener-cc9fa787e9e90dda082801b829751686-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,663 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,664 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,664 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,664 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,665 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,665 INFO [StoreOpener-f70e6c2f25c41dd4451000859071a3f7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,665 INFO [StoreOpener-a80c1bbbdf4887e2b3f39a590baf773c-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,665 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,666 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,667 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,667 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:10,667 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:10,668 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:10,670 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:10,670 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:10,671 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:10,675 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:10,675 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined cc9fa787e9e90dda082801b829751686; next sequenceid=2 2017-12-06 22:39:10,675 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:10,675 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined f70e6c2f25c41dd4451000859071a3f7; next sequenceid=2 2017-12-06 22:39:10,676 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:10,676 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined a80c1bbbdf4887e2b3f39a590baf773c; next sequenceid=2 2017-12-06 22:39:10,677 INFO [PostOpenDeployTasks:cc9fa787e9e90dda082801b829751686] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,678 INFO [PostOpenDeployTasks:f70e6c2f25c41dd4451000859071a3f7] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,678 INFO [PostOpenDeployTasks:a80c1bbbdf4887e2b3f39a590baf773c] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=33, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=30, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=31, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,682 DEBUG [PostOpenDeployTasks:f70e6c2f25c41dd4451000859071a3f7] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:10,683 DEBUG [PostOpenDeployTasks:cc9fa787e9e90dda082801b829751686] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:10,683 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,684 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,685 DEBUG [PostOpenDeployTasks:a80c1bbbdf4887e2b3f39a590baf773c] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:10,686 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,711 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=31 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,770 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=31, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:10,770 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=31, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c in 527msec 2017-12-06 22:39:10,770 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=33 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,809 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:10,811 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,817 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => a8c2a7e503bc2d570402d09ea53378ff, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.', STARTKEY => '', ENDKEY => 'a'} 2017-12-06 22:39:10,817 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionNoPreserveSplits a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:10,817 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,823 DEBUG [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:10,823 DEBUG [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:10,824 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,824 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,824 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,825 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,843 DEBUG [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:10,843 DEBUG [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:10,844 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:10,844 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:10,844 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:10,844 INFO [StoreOpener-a8c2a7e503bc2d570402d09ea53378ff-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:10,845 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,846 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:10,849 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:10,851 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=33, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:10,851 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=33, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686 in 585msec 2017-12-06 22:39:10,851 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=30 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,853 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:10,854 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined a8c2a7e503bc2d570402d09ea53378ff; next sequenceid=2 2017-12-06 22:39:10,856 INFO [PostOpenDeployTasks:a8c2a7e503bc2d570402d09ea53378ff] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=32, ppid=29, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,858 DEBUG [PostOpenDeployTasks:a8c2a7e503bc2d570402d09ea53378ff] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:10,860 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,903 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=30, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:10,903 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=30, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7 in 665msec 2017-12-06 22:39:10,904 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=32 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:10,961 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=32, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:11,009 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=29, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits; resume parent processing. 2017-12-06 22:39:11,010 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=32, ppid=29, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff in 719msec 2017-12-06 22:39:11,010 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599951010}]},"ts":1512599951010} 2017-12-06 22:39:11,015 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:11,120 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits in 1.9720sec 2017-12-06 22:39:11,171 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:11,176 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:11,177 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:11,179 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:11,191 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:39:11,194 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:39:11,196 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:39:11,202 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:11,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:11,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=34, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:11,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:11,353 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599951353}]},"ts":1512599951353} 2017-12-06 22:39:11,359 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to DISABLING in META 2017-12-06 22:39:11,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:11,412 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=36, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=37, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=38, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:11,462 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=38, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:11,462 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=38 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,466 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=38, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,535 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=37, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:11,536 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=37 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,540 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=37, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:11,586 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=36, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:11,587 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=36 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,591 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=36, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,617 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:11,618 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close cc9fa787e9e90dda082801b829751686 without moving 2017-12-06 22:39:11,618 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close f70e6c2f25c41dd4451000859071a3f7 without moving 2017-12-06 22:39:11,618 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:11,618 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:11,618 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close a80c1bbbdf4887e2b3f39a590baf773c without moving 2017-12-06 22:39:11,619 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.: disabling compactions & flushes 2017-12-06 22:39:11,620 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:11,620 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.: disabling compactions & flushes 2017-12-06 22:39:11,621 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.: disabling compactions & flushes 2017-12-06 22:39:11,621 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:11,621 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=2.88 KB 2017-12-06 22:39:11,622 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.store: f1 2017-12-06 22:39:11,620 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:11,622 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=800 B 2017-12-06 22:39:11,621 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:11,622 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.store: f1 2017-12-06 22:39:11,622 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=1.30 KB 2017-12-06 22:39:11,622 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,622 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.store: f1 2017-12-06 22:39:11,622 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.store: f2 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.store: f2 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.store: f2 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,623 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:11,643 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:11,645 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=35 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,652 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741858_1034{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5608 2017-12-06 22:39:11,658 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:11,661 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741859_1035{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5328 2017-12-06 22:39:11,661 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741860_1036{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:39:11,663 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.4 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/.tmp/f1/fe81a75729ab482d91bb91e63b7363e3 2017-12-06 22:39:11,699 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741861_1037{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 6440 2017-12-06 22:39:11,810 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:11,811 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close a8c2a7e503bc2d570402d09ea53378ff without moving 2017-12-06 22:39:11,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:12,053 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=668, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/.tmp/f1/a5e85f74ee44418284571e5f37a75237 2017-12-06 22:39:12,062 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/.tmp/f1/284f7c3f17eb4694a7e495fbde2ef7ae 2017-12-06 22:39:12,079 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741862_1038{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5608 2017-12-06 22:39:12,091 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741863_1039{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5328 2017-12-06 22:39:12,101 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.4 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/.tmp/f2/48355fc91bc846169222fa331290cc9b 2017-12-06 22:39:12,113 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/.tmp/f1/fe81a75729ab482d91bb91e63b7363e3 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1/fe81a75729ab482d91bb91e63b7363e3 2017-12-06 22:39:12,124 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1/fe81a75729ab482d91bb91e63b7363e3, entries=22, sequenceid=5, filesize=6.3 K 2017-12-06 22:39:12,125 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/.tmp/f2/48355fc91bc846169222fa331290cc9b as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2/48355fc91bc846169222fa331290cc9b 2017-12-06 22:39:12,137 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2/48355fc91bc846169222fa331290cc9b, entries=22, sequenceid=5, filesize=6.3 K 2017-12-06 22:39:12,138 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~2.88 KB/2944, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. in 517ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:12,141 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:12,142 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:12,150 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:12,151 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:12,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=38, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,153 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=38 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c., regionState=CLOSED 2017-12-06 22:39:12,154 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. 2017-12-06 22:39:12,154 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:12,155 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.: disabling compactions & flushes 2017-12-06 22:39:12,155 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:12,155 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=8.11 KB 2017-12-06 22:39:12,156 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.store: f1 2017-12-06 22:39:12,156 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:12,157 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.store: f2 2017-12-06 22:39:12,157 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:12,191 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741864_1040{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 9258 2017-12-06 22:39:12,210 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=38, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,210 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=38, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a80c1bbbdf4887e2b3f39a590baf773c, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 749msec 2017-12-06 22:39:12,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:12,481 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=668, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/.tmp/f2/07e4586f8471492a8080b72d6198f9b7 2017-12-06 22:39:12,493 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/.tmp/f2/b5d54561368f447f9ced269fa85f2564 2017-12-06 22:39:12,493 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/.tmp/f1/a5e85f74ee44418284571e5f37a75237 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1/a5e85f74ee44418284571e5f37a75237 2017-12-06 22:39:12,504 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/.tmp/f1/284f7c3f17eb4694a7e495fbde2ef7ae as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1/284f7c3f17eb4694a7e495fbde2ef7ae 2017-12-06 22:39:12,504 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1/a5e85f74ee44418284571e5f37a75237, entries=10, sequenceid=5, filesize=5.5 K 2017-12-06 22:39:12,506 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/.tmp/f2/07e4586f8471492a8080b72d6198f9b7 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2/07e4586f8471492a8080b72d6198f9b7 2017-12-06 22:39:12,515 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1/284f7c3f17eb4694a7e495fbde2ef7ae, entries=6, sequenceid=5, filesize=5.2 K 2017-12-06 22:39:12,518 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/.tmp/f2/b5d54561368f447f9ced269fa85f2564 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2/b5d54561368f447f9ced269fa85f2564 2017-12-06 22:39:12,519 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2/07e4586f8471492a8080b72d6198f9b7, entries=10, sequenceid=5, filesize=5.5 K 2017-12-06 22:39:12,520 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~1.30 KB/1336, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. in 898ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:12,523 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:12,524 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:12,531 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:12,532 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2/b5d54561368f447f9ced269fa85f2564, entries=6, sequenceid=5, filesize=5.2 K 2017-12-06 22:39:12,532 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:12,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=37, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,534 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~800 B/800, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. in 912ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:12,534 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=37 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7., regionState=CLOSED 2017-12-06 22:39:12,534 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. 2017-12-06 22:39:12,536 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:12,537 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:12,544 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:12,545 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:12,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=36, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,547 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. 2017-12-06 22:39:12,586 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=37, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,587 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=37, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=f70e6c2f25c41dd4451000859071a3f7, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1280sec 2017-12-06 22:39:12,587 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=36 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686., regionState=CLOSED 2017-12-06 22:39:12,593 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=4.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/.tmp/f1/e09a2866e8c244858f960fbb499b8a5e 2017-12-06 22:39:12,626 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741865_1041{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 9258 2017-12-06 22:39:12,645 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=36, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:12,645 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=36, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=cc9fa787e9e90dda082801b829751686, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1810sec 2017-12-06 22:39:13,028 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=4.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/.tmp/f2/d9fd25ae16e04cc3a44dd709847989ef 2017-12-06 22:39:13,041 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/.tmp/f1/e09a2866e8c244858f960fbb499b8a5e as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1/e09a2866e8c244858f960fbb499b8a5e 2017-12-06 22:39:13,051 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1/e09a2866e8c244858f960fbb499b8a5e, entries=62, sequenceid=5, filesize=9.0 K 2017-12-06 22:39:13,053 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/.tmp/f2/d9fd25ae16e04cc3a44dd709847989ef as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2/d9fd25ae16e04cc3a44dd709847989ef 2017-12-06 22:39:13,063 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2/d9fd25ae16e04cc3a44dd709847989ef, entries=62, sequenceid=5, filesize=9.0 K 2017-12-06 22:39:13,065 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~8.11 KB/8308, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. in 910ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:13,067 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:13,068 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:13,075 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:13,077 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:13,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:13,078 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=35 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff., regionState=CLOSED 2017-12-06 22:39:13,078 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. 2017-12-06 22:39:13,128 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=35, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:13,178 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=34, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits; resume parent processing. 2017-12-06 22:39:13,178 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=35, ppid=34, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=a8c2a7e503bc2d570402d09ea53378ff, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.6700sec 2017-12-06 22:39:13,179 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599953179}]},"ts":1512599953179} 2017-12-06 22:39:13,183 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to DISABLED in META 2017-12-06 22:39:13,183 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testRecoveryAndDoubleExecutionNoPreserveSplits, is completed. 2017-12-06 22:39:13,214 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:13,328 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits in 2.0420sec 2017-12-06 22:39:13,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=34 2017-12-06 22:39:13,371 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testRecoveryAndDoubleExecutionNoPreserveSplits completed 2017-12-06 22:39:13,623 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: true 2017-12-06 22:39:13,670 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=39, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:13,675 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testRecoveryAndDoubleExecutionNoPreserveSplits' regions in transition 2017-12-06 22:39:13,676 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:13,676 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:13,676 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:13,676 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:13,920 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 0 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:13,922 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:13,922 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:13,937 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741829_1005{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 89385 2017-12-06 22:39:14,340 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:14,341 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x6008709b to localhost:49877 2017-12-06 22:39:14,341 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:39:14,348 ERROR [Time-limited test] procedure2.ProcedureExecutor(594): Thread group java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] contains running threads java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] 2017-12-06 22:39:14,348 DEBUG [RS-EventLoopGroup-3-8] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46352. Number of active connections: 2 Thread[ReadOnlyZKClient,5,ProcExecThrdGrp] Thread[ReadOnlyZKClient-SendThread(localhost:49877),5,ProcExecThrdGrp] Thread[ReadOnlyZKClient-EventThread,5,ProcExecThrdGrp] Thread[hconnection-0x62050c2d-shared-pool8-t40,5,ProcExecThrdGrp] Thread[hconnection-0x62050c2d-shared-pool8-t41,5,ProcExecThrdGrp] 2017-12-06 22:39:14,349 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:14,349 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:14,349 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:14,353 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:14,361 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 8ms 2017-12-06 22:39:14,361 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:14,376 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 2 2017-12-06 22:39:14,377 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 2 2017-12-06 22:39:14,377 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 28msec 2017-12-06 22:39:14,399 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=39 2017-12-06 22:39:14,403 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:14,404 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:14,405 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:14,406 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:14,406 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:14,406 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:14,407 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:14,408 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:14,408 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:14,408 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:14,409 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:14,409 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:14,409 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:14,410 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:14,410 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:14,410 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:14,410 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:14,411 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 34msec 2017-12-06 22:39:14,412 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599984412 2017-12-06 22:39:14,413 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:14,413 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:14,482 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=40, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:14,482 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=40 2017-12-06 22:39:14,483 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=40, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:14,487 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:14,521 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=40, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:14,522 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:14,546 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=41, ppid=40, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:14,546 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=41, ppid=40, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:14,698 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=41, ppid=40, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:15,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=41, ppid=40, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,202 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599955201}]},"ts":1512599955201} 2017-12-06 22:39:15,206 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:15,206 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,287 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=41, ppid=40, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,369 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=40, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:15,370 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=41, ppid=40, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 695msec 2017-12-06 22:39:15,429 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 956msec 2017-12-06 22:39:15,431 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,437 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:15,441 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:15,441 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:15,448 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,449 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => a8c2a7e503bc2d570402d09ea53378ff, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.', STARTKEY => '', ENDKEY => 'a'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,449 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => cc9fa787e9e90dda082801b829751686, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.', STARTKEY => 'a', ENDKEY => 'b'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,450 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => f70e6c2f25c41dd4451000859071a3f7, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.', STARTKEY => 'b', ENDKEY => 'c'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,450 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => a80c1bbbdf4887e2b3f39a590baf773c, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.', STARTKEY => 'c', ENDKEY => ''} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:15,451 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:15,451 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:15,451 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:15,451 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:15,451 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599960451 2017-12-06 22:39:15,451 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 10msec, failover=false 2017-12-06 22:39:15,455 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testRecoveryAndDoubleExecutionNoPreserveSplits' regions in transition 2017-12-06 22:39:15,456 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:15,530 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955529}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955529}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955529}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955529}]},"ts":9223372036854775807} 2017-12-06 22:39:15,535 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:15,538 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => a8c2a7e503bc2d570402d09ea53378ff, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => cc9fa787e9e90dda082801b829751686, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => f70e6c2f25c41dd4451000859071a3f7, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => a80c1bbbdf4887e2b3f39a590baf773c, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:15,542 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testRecoveryAndDoubleExecutionNoPreserveSplits' from region states. 2017-12-06 22:39:15,543 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955542}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955542}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955542}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599955542}]},"ts":9223372036854775807} 2017-12-06 22:39:15,556 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:15,556 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => a8c2a7e503bc2d570402d09ea53378ff, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => cc9fa787e9e90dda082801b829751686, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => f70e6c2f25c41dd4451000859071a3f7, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => a80c1bbbdf4887e2b3f39a590baf773c, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:15,556 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testRecoveryAndDoubleExecutionNoPreserveSplits' as deleted. 2017-12-06 22:39:15,556 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599955556}]},"ts":9223372036854775807} 2017-12-06 22:39:15,560 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testRecoveryAndDoubleExecutionNoPreserveSplits state from META 2017-12-06 22:39:15,560 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:15,560 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:15,560 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:15,560 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:15,701 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 1 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:15,702 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:15,702 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:15,706 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741866_1042{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 2681 2017-12-06 22:39:16,108 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:16,109 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:16,110 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:16,110 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:16,112 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:16,113 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:16,113 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:16,119 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:16,120 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:16,120 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:16,127 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 3 2017-12-06 22:39:16,128 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 3 2017-12-06 22:39:16,128 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 18msec 2017-12-06 22:39:16,142 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=41 2017-12-06 22:39:16,143 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:16,144 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:16,145 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:16,146 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:16,146 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:16,146 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:16,147 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:16,147 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:16,148 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:16,148 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:16,148 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:16,149 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:16,150 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:16,150 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:16,150 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:16,151 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:16,151 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:16,151 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:16,152 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 22msec 2017-12-06 22:39:16,152 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599986152 2017-12-06 22:39:16,154 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:16,155 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:16,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=null, table=hbase:meta, region=1588230740 2017-12-06 22:39:16,204 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(953): META REPORTED but no procedure found (complete?) 2017-12-06 22:39:16,292 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=42, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:16,293 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=42 2017-12-06 22:39:16,294 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=42, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:16,298 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:16,343 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=42, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:16,343 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:16,400 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=43, ppid=42, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:16,400 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=43, ppid=42, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=true 2017-12-06 22:39:16,553 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:16,576 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=43, ppid=42, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:16,726 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:16,728 WARN [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1886): Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2017-12-06 22:39:17,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:17,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=43, ppid=42, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:17,207 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599957207}]},"ts":1512599957207} 2017-12-06 22:39:17,211 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:17,212 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:17,284 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=43, ppid=42, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:17,326 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=42, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:17,327 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=43, ppid=42, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 883msec 2017-12-06 22:39:17,385 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.1720sec 2017-12-06 22:39:17,386 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:17,394 WARN [Time-limited test] master.TableStateManager(218): Found table with no state, assuming ENABLED 2017-12-06 22:39:17,394 DEBUG [Time-limited test] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599957394}]},"ts":1512599957394} 2017-12-06 22:39:17,400 INFO [Time-limited test] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:17,400 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:17,405 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:17,405 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:17,413 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:17,413 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:17,413 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:17,414 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:17,414 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:17,414 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599962414 2017-12-06 22:39:17,414 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 9msec, failover=false 2017-12-06 22:39:17,415 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599957414}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599957414}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599957414}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599957414}]},"ts":9223372036854775807} 2017-12-06 22:39:17,419 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:17,419 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => a8c2a7e503bc2d570402d09ea53378ff, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => cc9fa787e9e90dda082801b829751686, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => f70e6c2f25c41dd4451000859071a3f7, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => a80c1bbbdf4887e2b3f39a590baf773c, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:17,423 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testRecoveryAndDoubleExecutionNoPreserveSplits' from region states. 2017-12-06 22:39:17,423 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): 2017-12-06 22:39:17,423 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 0 regions from META 2017-12-06 22:39:17,423 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [] 2017-12-06 22:39:17,423 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testRecoveryAndDoubleExecutionNoPreserveSplits' as deleted. 2017-12-06 22:39:17,515 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599957515}]},"ts":9223372036854775807} 2017-12-06 22:39:17,533 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testRecoveryAndDoubleExecutionNoPreserveSplits state from META 2017-12-06 22:39:17,534 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:17,588 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. from FS 2017-12-06 22:39:17,589 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:17,593 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits] 2017-12-06 22:39:17,609 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1/e09a2866e8c244858f960fbb499b8a5e, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1/e09a2866e8c244858f960fbb499b8a5e 2017-12-06 22:39:17,615 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2/d9fd25ae16e04cc3a44dd709847989ef, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2/d9fd25ae16e04cc3a44dd709847989ef 2017-12-06 22:39:17,633 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits/8.seqid 2017-12-06 22:39:17,634 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:55766 2017-12-06 22:39:17,635 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:17,635 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. from FS 2017-12-06 22:39:17,635 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:17,639 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits] 2017-12-06 22:39:17,651 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1/284f7c3f17eb4694a7e495fbde2ef7ae, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1/284f7c3f17eb4694a7e495fbde2ef7ae 2017-12-06 22:39:17,673 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2/b5d54561368f447f9ced269fa85f2564, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2/b5d54561368f447f9ced269fa85f2564 2017-12-06 22:39:17,681 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits/8.seqid 2017-12-06 22:39:17,682 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:55766 2017-12-06 22:39:17,682 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:17,682 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. from FS 2017-12-06 22:39:17,682 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:17,687 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits] 2017-12-06 22:39:17,694 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1/a5e85f74ee44418284571e5f37a75237, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1/a5e85f74ee44418284571e5f37a75237 2017-12-06 22:39:17,703 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2/07e4586f8471492a8080b72d6198f9b7, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2/07e4586f8471492a8080b72d6198f9b7 2017-12-06 22:39:17,709 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits/8.seqid 2017-12-06 22:39:17,710 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:55766 2017-12-06 22:39:17,710 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:17,710 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. from FS 2017-12-06 22:39:17,710 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:17,713 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits] 2017-12-06 22:39:17,729 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1/fe81a75729ab482d91bb91e63b7363e3, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1/fe81a75729ab482d91bb91e63b7363e3 2017-12-06 22:39:17,735 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2/48355fc91bc846169222fa331290cc9b, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2/48355fc91bc846169222fa331290cc9b 2017-12-06 22:39:17,741 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits/8.seqid 2017-12-06 22:39:17,742 INFO [IPC Server handler 2 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:55766 2017-12-06 22:39:17,743 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:17,743 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testRecoveryAndDoubleExecutionNoPreserveSplits' archived! 2017-12-06 22:39:17,744 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:55766 2017-12-06 22:39:17,745 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:17,745 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:17,746 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:17,747 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:17,898 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031] 2017-12-06 22:39:17,914 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 2 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:17,915 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:17,915 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:17,931 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741867_1043{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 3627 2017-12-06 22:39:18,332 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:18,332 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:18,333 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:18,333 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:18,334 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:18,335 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:18,335 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:18,341 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:18,342 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 0ms 2017-12-06 22:39:18,343 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:18,349 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:18,350 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:18,350 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:18,356 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 4 2017-12-06 22:39:18,358 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 4 2017-12-06 22:39:18,358 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 25msec 2017-12-06 22:39:18,367 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=43 2017-12-06 22:39:18,368 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:18,369 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:18,369 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:18,370 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:18,370 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:18,370 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:18,370 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:18,371 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:18,371 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:18,372 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:18,372 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:18,372 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:18,372 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:18,373 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:18,373 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:18,373 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:18,374 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:18,374 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:18,374 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:18,374 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 16msec 2017-12-06 22:39:18,375 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599988375 2017-12-06 22:39:18,376 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:18,376 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:18,482 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=44, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:18,482 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=44 2017-12-06 22:39:18,483 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=44, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:18,487 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:18,535 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=44, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:18,535 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:18,580 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:18,621 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=45, ppid=44, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:18,622 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=45, ppid=44, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:18,774 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=45, ppid=44, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:19,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=45, ppid=44, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,215 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599959215}]},"ts":1512599959215} 2017-12-06 22:39:19,219 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:19,219 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,304 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=45, ppid=44, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,354 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=44, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:19,354 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=45, ppid=44, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 707msec 2017-12-06 22:39:19,434 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 977msec 2017-12-06 22:39:19,435 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,439 WARN [Time-limited test] master.TableStateManager(218): Found table with no state, assuming ENABLED 2017-12-06 22:39:19,439 DEBUG [Time-limited test] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599959439}]},"ts":1512599959439} 2017-12-06 22:39:19,442 INFO [Time-limited test] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:19,442 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:19,445 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:19,445 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:19,450 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:19,451 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:19,451 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:19,451 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:19,451 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:19,451 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599964451 2017-12-06 22:39:19,451 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 6msec, failover=false 2017-12-06 22:39:19,452 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. from FS 2017-12-06 22:39:19,453 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:19,454 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff empty. 2017-12-06 22:39:19,454 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:19,454 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,a,1512599949086.cc9fa787e9e90dda082801b829751686. from FS 2017-12-06 22:39:19,455 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:19,455 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 empty. 2017-12-06 22:39:19,456 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:19,456 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,b,1512599949086.f70e6c2f25c41dd4451000859071a3f7. from FS 2017-12-06 22:39:19,456 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:19,457 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 empty. 2017-12-06 22:39:19,458 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:19,458 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,c,1512599949086.a80c1bbbdf4887e2b3f39a590baf773c. from FS 2017-12-06 22:39:19,458 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:19,459 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c empty. 2017-12-06 22:39:19,459 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:19,460 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testRecoveryAndDoubleExecutionNoPreserveSplits' archived! 2017-12-06 22:39:19,462 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:19,510 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741869_1045{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 1001 2017-12-06 22:39:19,914 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:19,916 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:19,929 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741870_1046{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|FINALIZED]]} size 0 2017-12-06 22:39:19,932 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:19,932 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.: disabling compactions & flushes 2017-12-06 22:39:19,932 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:19,932 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:19,935 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:19,935 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:19,935 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:19,935 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:19,952 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 3 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:19,952 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:19,952 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:19,968 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741868_1044{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 3391 2017-12-06 22:39:20,370 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:20,371 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:20,371 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:20,371 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:20,373 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:20,374 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:20,374 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:20,379 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:20,380 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:20,380 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:20,384 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:20,385 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:20,385 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:20,389 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:20,390 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:20,390 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:20,397 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 5 2017-12-06 22:39:20,398 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 5 2017-12-06 22:39:20,398 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 27msec 2017-12-06 22:39:20,414 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=45 2017-12-06 22:39:20,416 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,417 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,417 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,417 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:20,419 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:20,419 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:20,419 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:20,420 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:20,420 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:20,420 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:20,421 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:20,421 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:20,422 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:20,423 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:20,423 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:20,423 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:20,424 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:20,425 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:20,425 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,425 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:20,425 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 27msec 2017-12-06 22:39:20,426 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599990426 2017-12-06 22:39:20,426 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:20,428 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:20,514 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=46, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,515 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=46 2017-12-06 22:39:20,516 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=46, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:20,520 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:20,581 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=46, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:20,582 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=47, ppid=46, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:20,705 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=47, ppid=46, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:20,706 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=47, ppid=46, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:20,858 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=47, ppid=46, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=47, ppid=46, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,224 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599961223}]},"ts":1512599961223} 2017-12-06 22:39:21,229 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:21,229 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,289 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=47, ppid=46, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,339 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=46, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:21,339 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=47, ppid=46, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 661msec 2017-12-06 22:39:21,380 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 910msec 2017-12-06 22:39:21,382 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,386 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:21,390 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:21,390 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:21,398 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:21,398 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:21,398 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:21,398 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:21,399 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:21,399 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599966399 2017-12-06 22:39:21,399 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 9msec, failover=false 2017-12-06 22:39:21,425 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741872_1048{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 1001 2017-12-06 22:39:21,834 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:21,839 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionNoPreserveSplits HTD == 'testRecoveryAndDoubleExecutionNoPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:21,859 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741873_1049{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:22,261 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:22,262 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.: disabling compactions & flushes 2017-12-06 22:39:22,262 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:22,262 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionNoPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:22,264 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:55766 2017-12-06 22:39:22,264 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:55766 2017-12-06 22:39:22,265 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:22,308 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:22,313 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:39:22,313 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:22,313 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:22,313 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:22,314 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:22,400 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 4 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:22,400 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:22,400 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:22,404 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741871_1047{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 3395 2017-12-06 22:39:22,805 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:22,806 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:22,806 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:22,807 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:22,808 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:22,809 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:22,809 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:22,815 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:22,816 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 0ms 2017-12-06 22:39:22,817 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:22,821 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:22,822 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:22,822 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:22,826 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:22,826 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 0ms 2017-12-06 22:39:22,827 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:22,831 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:22,831 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 0ms 2017-12-06 22:39:22,832 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:22,838 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 6 2017-12-06 22:39:22,839 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 6 2017-12-06 22:39:22,839 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 32msec 2017-12-06 22:39:22,854 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=47 2017-12-06 22:39:22,855 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,856 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,856 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,856 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,857 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:22,858 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:22,862 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:22,863 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:22,863 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:22,864 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:22,864 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:22,865 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:22,866 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:22,866 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:22,866 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:22,867 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:22,867 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:22,867 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:22,868 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:22,868 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,868 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:22,869 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 30msec 2017-12-06 22:39:22,870 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599992870 2017-12-06 22:39:22,870 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:22,873 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:22,950 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=48, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,951 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=48 2017-12-06 22:39:22,951 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=48, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:22,956 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:23,006 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=48, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,007 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=49, ppid=48, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:23,072 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=49, ppid=48, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:23,073 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=49, ppid=48, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:23,224 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=49, ppid=48, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:23,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=49, ppid=48, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,300 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599963300}]},"ts":1512599963300} 2017-12-06 22:39:23,305 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:23,306 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,364 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=49, ppid=48, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,405 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=48, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:23,405 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=49, ppid=48, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 310msec 2017-12-06 22:39:23,447 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 533msec 2017-12-06 22:39:23,448 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,452 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:23,456 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:23,456 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:23,461 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,462 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} regionState=null lastHost=null regionLocation=null 2017-12-06 22:39:23,462 INFO [Time-limited test] assignment.AssignmentManager$1(1191): afe69639e9a13c04ca437d3e5f209059 state=null; presuming OFFLINE 2017-12-06 22:39:23,462 INFO [Time-limited test] assignment.RegionStates(852): Added to offline, CURRENTLY NEVER CLEARED!!! rit=OFFLINE, location=null, table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:23,462 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:23,465 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 3msec 2017-12-06 22:39:23,465 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:23,505 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=50, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:23,506 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 40msec 2017-12-06 22:39:23,507 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599968506 2017-12-06 22:39:23,508 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=50, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,508 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 52msec, failover=false 2017-12-06 22:39:23,510 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=50, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:23,662 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=50 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,664 INFO [ProcExecWrkr-1] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x483f7294 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:39:23,686 DEBUG [ProcExecWrkr-1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@793d7ac9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:39:23,688 DEBUG [MultiHConnection-shared--pool18-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:39:23,695 DEBUG [RS-EventLoopGroup-3-11] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46774; # active connections: 3 2017-12-06 22:39:23,696 INFO [RS-EventLoopGroup-3-11] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:39:23,697 INFO [RS-EventLoopGroup-3-11] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46774 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:39:23,701 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=50, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,852 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:23,855 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,860 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} 2017-12-06 22:39:23,861 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionNoPreserveSplits afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:23,861 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,867 DEBUG [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:23,867 DEBUG [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:23,868 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:23,868 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:23,869 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:23,870 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:23,874 DEBUG [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:23,874 DEBUG [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:23,874 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:23,874 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:23,875 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:23,875 INFO [StoreOpener-afe69639e9a13c04ca437d3e5f209059-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:23,876 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,877 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:23,880 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionNoPreserveSplits, use config (67108864) instead 2017-12-06 22:39:23,884 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:23,884 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined afe69639e9a13c04ca437d3e5f209059; next sequenceid=2 2017-12-06 22:39:23,886 INFO [PostOpenDeployTasks:afe69639e9a13c04ca437d3e5f209059] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=50, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,888 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=50 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,888 DEBUG [PostOpenDeployTasks:afe69639e9a13c04ca437d3e5f209059] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:23,891 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:23,896 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:23,899 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741869_1045, blk_1073741870_1046] 2017-12-06 22:39:23,939 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 in 431msec 2017-12-06 22:39:23,941 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:23,944 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:39:23,944 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:23,944 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:23,945 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:23,945 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:24,008 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 5 exec state=pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:24,009 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:24,009 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:24,013 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741874_1050{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 3013 2017-12-06 22:39:24,416 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:24,416 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x483f7294 to localhost:49877 2017-12-06 22:39:24,416 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:39:24,417 ERROR [Time-limited test] procedure2.ProcedureExecutor(594): Thread group java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] contains running threads java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] Thread[ReadOnlyZKClient,5,ProcExecThrdGrp] 2017-12-06 22:39:24,417 DEBUG [RS-EventLoopGroup-3-11] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46774. Number of active connections: 2 Thread[ReadOnlyZKClient-SendThread(localhost:49877),5,ProcExecThrdGrp] Thread[ReadOnlyZKClient-EventThread,5,ProcExecThrdGrp] 2017-12-06 22:39:24,418 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:24,418 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:24,418 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:24,420 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:24,421 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:24,421 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,429 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:24,430 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:24,430 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,434 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:24,435 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:24,435 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,440 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:24,440 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 0ms 2017-12-06 22:39:24,441 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,445 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:24,446 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:24,446 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,450 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:24,451 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:24,451 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:24,457 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 7 2017-12-06 22:39:24,458 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 7 2017-12-06 22:39:24,459 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 41msec 2017-12-06 22:39:24,475 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=50 2017-12-06 22:39:24,476 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:24,477 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,478 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,478 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,478 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,478 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,479 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:24,479 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:24,480 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:24,480 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:24,480 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:24,481 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:24,481 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:24,481 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:24,482 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:24,482 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:24,482 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:24,483 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:24,483 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:24,483 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:24,484 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:24,484 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,484 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:24,484 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 25msec 2017-12-06 22:39:24,485 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599994485 2017-12-06 22:39:24,486 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:24,486 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:24,575 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=51, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,575 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=51 2017-12-06 22:39:24,576 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=51, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:24,580 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:24,639 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=51, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:24,639 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:24,675 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=52, ppid=51, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:24,675 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=52, ppid=51, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:24,827 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=52, ppid=51, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:25,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=52, ppid=51, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,240 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599965240}]},"ts":1512599965240} 2017-12-06 22:39:25,244 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:25,244 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,272 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:39:25,354 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=52, ppid=51, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,388 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=51, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:25,388 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=52, ppid=51, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 636msec 2017-12-06 22:39:25,421 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 902msec 2017-12-06 22:39:25,422 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,426 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:25,429 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:25,429 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:25,434 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,434 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:25,435 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:25,435 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:25,435 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:25,435 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:25,435 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599970435 2017-12-06 22:39:25,436 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 7msec, failover=false 2017-12-06 22:39:25,438 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:25,441 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 1 2017-12-06 22:39:25,441 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:25,479 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599965479}]},"ts":1512599965479} 2017-12-06 22:39:25,483 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLING in META 2017-12-06 22:39:25,485 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=53, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059}] 2017-12-06 22:39:25,486 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:25,486 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=WAITING:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:25,486 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:25,486 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:25,686 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 6 exec state=pid=39, state=WAITING:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:25,686 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:25,686 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:25,691 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741875_1051{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 3400 2017-12-06 22:39:26,093 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:26,093 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:26,094 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:26,094 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:26,095 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:26,097 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:26,097 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,102 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:26,103 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 0ms 2017-12-06 22:39:26,104 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,108 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:26,109 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:26,109 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,114 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:26,114 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 0ms 2017-12-06 22:39:26,115 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,119 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:26,120 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:26,120 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,124 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:26,125 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:26,125 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,129 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:26,130 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:26,130 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:26,135 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 8 2017-12-06 22:39:26,136 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 8 2017-12-06 22:39:26,137 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 43msec 2017-12-06 22:39:26,155 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=52 2017-12-06 22:39:26,156 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,157 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,158 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:26,159 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:26,159 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:26,159 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:26,160 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:26,161 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:26,161 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:26,162 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:26,163 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:26,163 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:26,164 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:26,164 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:26,165 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:26,165 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:26,166 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:26,166 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,166 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:26,167 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 30msec 2017-12-06 22:39:26,167 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599996167 2017-12-06 22:39:26,168 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:26,168 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:26,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=null, table=hbase:meta, region=1588230740 2017-12-06 22:39:26,242 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(953): META REPORTED but no procedure found (complete?) 2017-12-06 22:39:26,251 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=53, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,252 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=53 2017-12-06 22:39:26,253 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=53, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:26,257 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:26,295 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=53, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:26,296 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:26,333 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=54, ppid=53, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:26,333 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=54, ppid=53, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=true 2017-12-06 22:39:26,487 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:26,492 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=54, ppid=53, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:26,643 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:26,645 WARN [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1886): Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2017-12-06 22:39:27,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:27,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=54, ppid=53, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,246 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599967246}]},"ts":1512599967246} 2017-12-06 22:39:27,251 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:27,251 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,295 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=54, ppid=53, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,332 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=53, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:27,333 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=54, ppid=53, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 963msec 2017-12-06 22:39:27,378 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.1640sec 2017-12-06 22:39:27,379 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,383 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:27,386 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:27,387 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:27,392 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,392 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,393 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:27,393 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:27,393 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:27,393 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:27,393 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599972393 2017-12-06 22:39:27,393 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 6msec, failover=false 2017-12-06 22:39:27,394 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599967394}]},"ts":1512599967394} 2017-12-06 22:39:27,398 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLING in META 2017-12-06 22:39:27,398 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059}] 2017-12-06 22:39:27,398 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:27,441 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:27,441 INFO [ProcExecWrkr-1] assignment.AssignProcedure(155): Assigned, not reassigning; pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059; rit=OPEN, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:27,441 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:27,441 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=55, ppid=39, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:27,442 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:27,442 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:27,644 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 7 exec state=pid=39, state=WAITING:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:27,644 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:27,644 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:27,649 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741876_1052{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 2618 2017-12-06 22:39:28,051 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:28,052 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:28,052 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:28,052 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:28,054 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:28,055 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:28,055 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,061 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:28,062 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:28,062 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,068 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:28,069 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:28,069 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,074 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:28,075 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:28,075 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,079 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:28,080 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:28,080 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,084 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:28,085 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:28,085 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,089 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:28,090 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:28,090 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,095 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:28,095 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 0ms 2017-12-06 22:39:28,096 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:28,102 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 9 2017-12-06 22:39:28,103 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 9 2017-12-06 22:39:28,103 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 51msec 2017-12-06 22:39:28,128 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=55 2017-12-06 22:39:28,128 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,129 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,129 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:28,129 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,129 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,130 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,130 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,130 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,130 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:28,131 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:28,131 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:28,132 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:28,132 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:28,132 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:28,132 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:28,133 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:28,134 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:28,134 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:28,134 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:28,135 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:28,135 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:28,135 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:28,136 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:28,136 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,136 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:28,136 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=WAITING:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:28,137 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 34msec 2017-12-06 22:39:28,137 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512599998137 2017-12-06 22:39:28,139 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:28,139 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:28,215 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=56, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,215 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=56 2017-12-06 22:39:28,216 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=56, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:28,220 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:28,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=null, table=hbase:meta, region=1588230740 2017-12-06 22:39:28,248 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(953): META REPORTED but no procedure found (complete?) 2017-12-06 22:39:28,277 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=56, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:28,277 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:28,318 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=57, ppid=56, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:28,318 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=57, ppid=56, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=true 2017-12-06 22:39:28,471 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:28,484 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=57, ppid=56, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:28,634 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:28,636 WARN [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1886): Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2017-12-06 22:39:29,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:29,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=57, ppid=56, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,252 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599969251}]},"ts":1512599969251} 2017-12-06 22:39:29,256 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:29,256 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,365 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:29,560 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=57, ppid=56, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,626 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=56, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:29,626 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=57, ppid=56, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.2230sec 2017-12-06 22:39:29,684 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.4880sec 2017-12-06 22:39:29,686 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,689 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:29,692 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:29,693 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:29,697 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,698 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,698 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:29,698 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:29,698 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:29,698 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:29,698 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599974698 2017-12-06 22:39:29,699 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 6msec, failover=false 2017-12-06 22:39:29,699 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:29,699 INFO [ProcExecWrkr-1] assignment.AssignProcedure(155): Assigned, not reassigning; pid=55, ppid=39, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059; rit=OPEN, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:29,699 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:29,726 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=55, ppid=39, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:29,784 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=39, state=RUNNABLE:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false); resume parent processing. 2017-12-06 22:39:29,784 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=55, ppid=39, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 in 2.3010sec 2017-12-06 22:39:29,784 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599969784}]},"ts":1512599969784} 2017-12-06 22:39:29,789 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:29,789 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(134): truncate 'testRecoveryAndDoubleExecutionNoPreserveSplits' completed 2017-12-06 22:39:29,789 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:29,789 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:29,789 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:29,789 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:29,949 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 8 exec state=pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:29,949 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:29,949 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:29,954 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741877_1053{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 2625 2017-12-06 22:39:30,356 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:30,357 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:30,357 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:30,357 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:30,359 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:30,360 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:30,360 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,365 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:30,366 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:30,366 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,370 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:30,371 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 0ms 2017-12-06 22:39:30,371 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,376 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:30,377 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:30,377 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,381 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:30,382 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:30,382 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,386 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:30,387 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:30,387 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,391 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:30,392 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:30,392 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,396 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:30,397 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 1ms 2017-12-06 22:39:30,397 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,402 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:30,403 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 1ms 2017-12-06 22:39:30,403 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:30,411 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 10 2017-12-06 22:39:30,412 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 10 2017-12-06 22:39:30,413 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 56msec 2017-12-06 22:39:30,441 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=57 2017-12-06 22:39:30,442 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,443 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,443 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,443 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:30,444 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,444 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,444 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,444 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,445 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,445 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:30,446 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:30,446 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:30,446 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:30,447 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:30,447 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:30,447 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:30,448 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:30,448 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:30,449 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:30,449 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:30,450 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:30,450 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:30,450 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:30,450 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:30,451 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,451 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=39, state=RUNNABLE:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:30,451 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=55, ppid=39, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:30,451 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 38msec 2017-12-06 22:39:30,452 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600000452 2017-12-06 22:39:30,452 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:30,453 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=39, state=RUNNABLE:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:30,530 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=58, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,530 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=58 2017-12-06 22:39:30,531 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=58, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:30,535 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:30,602 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=58, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:30,603 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=59, ppid=58, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:30,668 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=59, ppid=58, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:30,669 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=59, ppid=58, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:30,820 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=59, ppid=58, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=59, ppid=58, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,260 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599971260}]},"ts":1512599971260} 2017-12-06 22:39:31,265 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:31,265 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,370 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=59, ppid=58, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,453 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=58, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:31,454 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=59, ppid=58, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 682msec 2017-12-06 22:39:31,520 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.0000sec 2017-12-06 22:39:31,521 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,525 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:31,528 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:31,528 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:31,534 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,535 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:31,535 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:31,536 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:31,536 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:31,536 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:31,536 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599976536 2017-12-06 22:39:31,536 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 8msec, failover=false 2017-12-06 22:39:31,537 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599971537}]},"ts":1512599971537} 2017-12-06 22:39:31,541 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to ENABLED in META 2017-12-06 22:39:31,541 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(134): truncate 'testRecoveryAndDoubleExecutionNoPreserveSplits' completed 2017-12-06 22:39:31,541 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:31,593 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) in 17.9170sec 2017-12-06 22:39:31,787 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:31,787 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:39:31,793 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:39:31,798 DEBUG [Time-limited test] util.CommonFSUtils(736): Current file system: 2017-12-06 22:39:31,800 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tabledesc/ 2017-12-06 22:39:31,801 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.tableinfo.0000000001 2017-12-06 22:39:31,801 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tmp/ 2017-12-06 22:39:31,802 DEBUG [Time-limited test] util.CommonFSUtils(754): |-afe69639e9a13c04ca437d3e5f209059/ 2017-12-06 22:39:31,803 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:39:31,803 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:39:31,803 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:39:31,804 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:39:31,805 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:39:31,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 112 service: ClientService methodName: Scan size: 152 connection: 67.195.81.155:46382 deadline: 1512600031818 org.apache.hadoop.hbase.NotServingRegionException: testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599949086.a8c2a7e503bc2d570402d09ea53378ff. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:39:31,942 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:32,056 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:32,062 INFO [Time-limited test] procedure.TestTableDDLProcedureBase(67): Tear down, remove table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:32,063 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:32,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:32,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=60, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:32,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:32,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:32,228 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599972228}]},"ts":1512599972228} 2017-12-06 22:39:32,233 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to DISABLING in META 2017-12-06 22:39:32,302 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:32,372 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=61, ppid=60, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionNoPreserveSplits testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:32,372 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=61 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059., regionState=CLOSING 2017-12-06 22:39:32,373 INFO [ProcExecWrkr-1] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x7316e062 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:39:32,393 DEBUG [ProcExecWrkr-1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ad8828, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:39:32,396 DEBUG [MultiHConnection-shared--pool20-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:39:32,402 DEBUG [RS-EventLoopGroup-3-13] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:46854; # active connections: 3 2017-12-06 22:39:32,404 INFO [RS-EventLoopGroup-3-13] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:39:32,405 INFO [RS-EventLoopGroup-3-13] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 46854 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:39:32,408 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=61, ppid=60, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:32,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:32,558 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:32,560 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close afe69639e9a13c04ca437d3e5f209059 without moving 2017-12-06 22:39:32,560 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:32,561 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.: disabling compactions & flushes 2017-12-06 22:39:32,561 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:32,562 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=6.53 KB 2017-12-06 22:39:32,562 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.store: f1 2017-12-06 22:39:32,562 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:32,563 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.store: f2 2017-12-06 22:39:32,563 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:32,580 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741879_1055{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 8372 2017-12-06 22:39:32,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:32,982 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=6, memsize=3.3 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/.tmp/f1/2520b86a3ee64cf0a2d69899a23f6849 2017-12-06 22:39:33,006 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741880_1056{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 8372 2017-12-06 22:39:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:33,408 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=6, memsize=3.3 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/.tmp/f2/d7e8ad6f396b4829b654627d4bea4cd3 2017-12-06 22:39:33,419 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/.tmp/f1/2520b86a3ee64cf0a2d69899a23f6849 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1/2520b86a3ee64cf0a2d69899a23f6849 2017-12-06 22:39:33,436 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1/2520b86a3ee64cf0a2d69899a23f6849, entries=50, sequenceid=6, filesize=8.2 K 2017-12-06 22:39:33,438 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/.tmp/f2/d7e8ad6f396b4829b654627d4bea4cd3 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2/d7e8ad6f396b4829b654627d4bea4cd3 2017-12-06 22:39:33,446 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2/d7e8ad6f396b4829b654627d4bea4cd3, entries=50, sequenceid=6, filesize=8.2 K 2017-12-06 22:39:33,448 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~6.53 KB/6688, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. in 887ms, sequenceid=6, compaction requested=false 2017-12-06 22:39:33,450 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:33,453 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:33,460 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits/9.seqid, newSeqId=9, maxSeqId=2 2017-12-06 22:39:33,462 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:33,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=61, ppid=60, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:33,464 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=61 updating hbase:meta row=testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059., regionState=CLOSED 2017-12-06 22:39:33,464 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. 2017-12-06 22:39:33,511 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=61, ppid=60, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:33,553 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=60, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits; resume parent processing. 2017-12-06 22:39:33,553 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=61, ppid=60, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1680sec 2017-12-06 22:39:33,554 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599973553}]},"ts":1512599973553} 2017-12-06 22:39:33,558 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionNoPreserveSplits state to DISABLED in META 2017-12-06 22:39:33,558 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testRecoveryAndDoubleExecutionNoPreserveSplits, is completed. 2017-12-06 22:39:33,678 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits in 1.5520sec 2017-12-06 22:39:34,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=60 2017-12-06 22:39:34,236 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testRecoveryAndDoubleExecutionNoPreserveSplits completed 2017-12-06 22:39:34,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.HMaster$5(2101): Client=jenkins//67.195.81.155 delete testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:34,707 WARN [DataXceiver for client DFSClient_NONMAPREDUCE_-1064546853_1 at /127.0.0.1:37911 [Receiving block BP-109774452-67.195.81.155-1512599919954:blk_1073741878_1054]] datanode.BlockReceiver(422): Slow flushOrSync took 469ms (threshold=300ms), isSync:true, flushTotalNanos=6800ns 2017-12-06 22:39:34,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=62, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:34,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=62 2017-12-06 22:39:34,712 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(99): Waiting for 'testRecoveryAndDoubleExecutionNoPreserveSplits' regions in transition 2017-12-06 22:39:34,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=62 2017-12-06 22:39:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=62 2017-12-06 22:39:35,032 WARN [DataXceiver for client DFSClient_NONMAPREDUCE_-1064546853_1 at /127.0.0.1:37911 [Receiving block BP-109774452-67.195.81.155-1512599919954:blk_1073741878_1054]] datanode.BlockReceiver(422): Slow flushOrSync took 319ms (threshold=300ms), isSync:true, flushTotalNanos=6182ns 2017-12-06 22:39:35,032 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(110): delete 'testRecoveryAndDoubleExecutionNoPreserveSplits' regions from META 2017-12-06 22:39:35,033 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599975033}]},"ts":9223372036854775807} 2017-12-06 22:39:35,037 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:39:35,037 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:39:35,119 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(115): delete 'testRecoveryAndDoubleExecutionNoPreserveSplits' from filesystem 2017-12-06 22:39:35,123 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059. from FS 2017-12-06 22:39:35,123 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:35,127 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits] 2017-12-06 22:39:35,134 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1/2520b86a3ee64cf0a2d69899a23f6849, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1/2520b86a3ee64cf0a2d69899a23f6849 2017-12-06 22:39:35,140 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2/d7e8ad6f396b4829b654627d4bea4cd3, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2/d7e8ad6f396b4829b654627d4bea4cd3 2017-12-06 22:39:35,146 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits/9.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits/9.seqid 2017-12-06 22:39:35,147 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741873_1049 127.0.0.1:55766 2017-12-06 22:39:35,147 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:35,147 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testRecoveryAndDoubleExecutionNoPreserveSplits' archived! 2017-12-06 22:39:35,148 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741872_1048 127.0.0.1:55766 2017-12-06 22:39:35,211 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(121): delete 'testRecoveryAndDoubleExecutionNoPreserveSplits' descriptor 2017-12-06 22:39:35,211 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(399): Removing 'testRecoveryAndDoubleExecutionNoPreserveSplits' descriptor. 2017-12-06 22:39:35,261 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(126): delete 'testRecoveryAndDoubleExecutionNoPreserveSplits' assignment state 2017-12-06 22:39:35,261 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testRecoveryAndDoubleExecutionNoPreserveSplits' from region states. 2017-12-06 22:39:35,262 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599975262}]},"ts":9223372036854775807} 2017-12-06 22:39:35,266 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 1 regions from META 2017-12-06 22:39:35,266 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => afe69639e9a13c04ca437d3e5f209059, NAME => 'testRecoveryAndDoubleExecutionNoPreserveSplits,,1512599959462.afe69639e9a13c04ca437d3e5f209059.', STARTKEY => '', ENDKEY => ''}] 2017-12-06 22:39:35,266 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testRecoveryAndDoubleExecutionNoPreserveSplits' as deleted. 2017-12-06 22:39:35,266 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionNoPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599975266}]},"ts":9223372036854775807} 2017-12-06 22:39:35,276 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testRecoveryAndDoubleExecutionNoPreserveSplits state from META 2017-12-06 22:39:35,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=62 2017-12-06 22:39:35,349 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(132): delete 'testRecoveryAndDoubleExecutionNoPreserveSplits' completed 2017-12-06 22:39:35,453 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits in 1.1120sec 2017-12-06 22:39:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=62 2017-12-06 22:39:35,821 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DELETE, Table Name: default:testRecoveryAndDoubleExecutionNoPreserveSplits completed 2017-12-06 22:39:35,851 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testRecoveryAndDoubleExecutionNoPreserveSplits Thread=245 (was 261), OpenFileDescriptor=798 (was 802), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 623), ProcessCount=250 (was 249) - ProcessCount LEAK? -, AvailableMemoryMB=12280 (was 12868) 2017-12-06 22:39:35,875 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testRecoveryAndDoubleExecutionPreserveSplits Thread=245, OpenFileDescriptor=795, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=250, AvailableMemoryMB=12280 2017-12-06 22:39:35,876 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:39:35,900 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741872_1048, blk_1073741873_1049] 2017-12-06 22:39:35,948 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=63, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:36,024 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741881_1057{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:39:36,029 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:36,032 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:36,034 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:36,040 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:36,041 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:36,056 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741882_1058{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|FINALIZED]]} size 0 2017-12-06 22:39:36,083 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:36,083 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.: disabling compactions & flushes 2017-12-06 22:39:36,084 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:36,084 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:36,084 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741884_1060{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 80 2017-12-06 22:39:36,087 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741883_1059{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:36,091 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741885_1061{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:36,486 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:36,487 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.: disabling compactions & flushes 2017-12-06 22:39:36,487 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:36,487 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:36,488 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:36,489 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.: disabling compactions & flushes 2017-12-06 22:39:36,489 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:36,489 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:36,493 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:36,493 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.: disabling compactions & flushes 2017-12-06 22:39:36,493 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:36,493 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:36,607 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.","families":{"info":[{"qualifier":"regioninfo","vlen":79,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.","families":{"info":[{"qualifier":"regioninfo","vlen":79,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:36,614 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:39:36,674 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599976674}]},"ts":1512599976674} 2017-12-06 22:39:36,678 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to ENABLING in META 2017-12-06 22:39:36,679 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4}, {pid=65, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0}, {pid=66, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234}, {pid=67, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9}] 2017-12-06 22:39:36,810 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=67, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:36,812 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=67, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:36,891 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=66, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:36,894 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=66, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:36,975 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=67 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:36,983 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=67, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,033 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=66 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,038 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=66, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,125 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=65, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,127 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=65, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:37,133 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:37,134 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:37,138 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:37,139 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => 6e0328adbd37a167dccc80b8dd2b0de9, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.', STARTKEY => 'b', ENDKEY => 'c'} 2017-12-06 22:39:37,139 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => c045ee6cbe9d5cfbf9869e49fcdf3234, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:39:37,139 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionPreserveSplits 6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:37,139 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:37,139 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionPreserveSplits c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:37,140 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:37,144 DEBUG [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:37,145 DEBUG [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:37,145 DEBUG [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:37,145 DEBUG [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:37,145 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,145 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,145 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,145 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,145 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,146 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,146 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,146 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,149 DEBUG [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:37,149 DEBUG [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:37,149 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,149 DEBUG [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:37,149 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,149 DEBUG [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:37,149 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,150 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,150 INFO [StoreOpener-c045ee6cbe9d5cfbf9869e49fcdf3234-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,150 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,150 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,150 INFO [StoreOpener-6e0328adbd37a167dccc80b8dd2b0de9-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,151 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:37,151 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:37,152 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:37,152 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:37,153 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionPreserveSplits, use config (67108864) instead 2017-12-06 22:39:37,154 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionPreserveSplits, use config (67108864) instead 2017-12-06 22:39:37,157 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:37,157 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined c045ee6cbe9d5cfbf9869e49fcdf3234; next sequenceid=2 2017-12-06 22:39:37,158 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:37,158 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined 6e0328adbd37a167dccc80b8dd2b0de9; next sequenceid=2 2017-12-06 22:39:37,163 INFO [PostOpenDeployTasks:6e0328adbd37a167dccc80b8dd2b0de9] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:37,163 INFO [PostOpenDeployTasks:c045ee6cbe9d5cfbf9869e49fcdf3234] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=67, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=66, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,166 DEBUG [PostOpenDeployTasks:6e0328adbd37a167dccc80b8dd2b0de9] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:37,167 DEBUG [PostOpenDeployTasks:c045ee6cbe9d5cfbf9869e49fcdf3234] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:37,167 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,168 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,175 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=66 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,254 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=66, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:37,255 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=66, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234 in 504msec 2017-12-06 22:39:37,255 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=67 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,273 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:39:37,304 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=67, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:37,305 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=67, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9 in 581msec 2017-12-06 22:39:37,305 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=65 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,308 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=65, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,358 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=64, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,361 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=64, ppid=63, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:37,459 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:37,460 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,465 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => 952d01842eadd6d92f061dc09880e3a0, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.', STARTKEY => 'c', ENDKEY => ''} 2017-12-06 22:39:37,466 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionPreserveSplits 952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:37,466 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,472 DEBUG [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:37,472 DEBUG [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:37,473 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,473 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,474 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,474 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,477 DEBUG [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:37,478 DEBUG [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:37,478 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,478 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,478 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,478 INFO [StoreOpener-952d01842eadd6d92f061dc09880e3a0-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,480 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,480 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:37,482 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionPreserveSplits, use config (67108864) instead 2017-12-06 22:39:37,486 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:37,486 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined 952d01842eadd6d92f061dc09880e3a0; next sequenceid=2 2017-12-06 22:39:37,488 INFO [PostOpenDeployTasks:952d01842eadd6d92f061dc09880e3a0] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=65, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,490 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=65 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,490 DEBUG [PostOpenDeployTasks:952d01842eadd6d92f061dc09880e3a0] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:37,491 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,541 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=65, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:37,542 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=65, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0 in 816msec 2017-12-06 22:39:37,542 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=64 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,546 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=64, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,696 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:37,698 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,702 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => 5e438ded1a553f64ae16215522e079c4, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.', STARTKEY => '', ENDKEY => 'a'} 2017-12-06 22:39:37,703 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionPreserveSplits 5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:37,703 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,712 DEBUG [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:37,712 DEBUG [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:37,713 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,713 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,713 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,713 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,717 DEBUG [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:37,717 DEBUG [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:37,718 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:37,718 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:37,718 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:37,718 INFO [StoreOpener-5e438ded1a553f64ae16215522e079c4-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:37,720 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,720 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:37,723 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionPreserveSplits, use config (67108864) instead 2017-12-06 22:39:37,726 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:37,727 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined 5e438ded1a553f64ae16215522e079c4; next sequenceid=2 2017-12-06 22:39:37,728 INFO [PostOpenDeployTasks:5e438ded1a553f64ae16215522e079c4] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=64, ppid=63, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,730 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=64 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,730 DEBUG [PostOpenDeployTasks:5e438ded1a553f64ae16215522e079c4] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:37,731 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:37,775 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=64, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:37,842 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=63, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits; resume parent processing. 2017-12-06 22:39:37,842 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=64, ppid=63, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4 in 1.0550sec 2017-12-06 22:39:37,843 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599977842}]},"ts":1512599977842} 2017-12-06 22:39:37,848 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to ENABLED in META 2017-12-06 22:39:37,961 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits in 2.0160sec 2017-12-06 22:39:38,230 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:38,233 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:38,233 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:38,234 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:39:38,241 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:39:38,243 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:39:38,246 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:39:38,249 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:38,251 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:38,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=68, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:38,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:38,423 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599978423}]},"ts":1512599978423} 2017-12-06 22:39:38,428 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to DISABLING in META 2017-12-06 22:39:38,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:38,473 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=70, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=71, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=72, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:38,532 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=72, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:38,532 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=72 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,539 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=72, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,606 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=71, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:38,607 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=71 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,614 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=71, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:38,665 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=70, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:38,665 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=70 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,670 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=70, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,690 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:38,691 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close c045ee6cbe9d5cfbf9869e49fcdf3234 without moving 2017-12-06 22:39:38,692 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 6e0328adbd37a167dccc80b8dd2b0de9 without moving 2017-12-06 22:39:38,692 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:38,692 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:38,692 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 952d01842eadd6d92f061dc09880e3a0 without moving 2017-12-06 22:39:38,693 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.: disabling compactions & flushes 2017-12-06 22:39:38,694 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:38,694 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.: disabling compactions & flushes 2017-12-06 22:39:38,694 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:38,695 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.: disabling compactions & flushes 2017-12-06 22:39:38,695 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:38,695 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:38,695 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=666 B 2017-12-06 22:39:38,696 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=2.74 KB 2017-12-06 22:39:38,696 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=666 B 2017-12-06 22:39:38,696 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.store: f1 2017-12-06 22:39:38,696 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.store: f1 2017-12-06 22:39:38,696 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.store: f1 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.store: f2 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.store: f2 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,697 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.store: f2 2017-12-06 22:39:38,698 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:38,713 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741886_1062{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:39:38,714 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741887_1063{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 6372 2017-12-06 22:39:38,715 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=69, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:38,715 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=69 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,716 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741888_1064{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:39:38,719 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=69, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:38,870 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:38,871 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 5e438ded1a553f64ae16215522e079c4 without moving 2017-12-06 22:39:38,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:38,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:39,115 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/.tmp/f1/87d60f4fe6864703837c3883a9bbca08 2017-12-06 22:39:39,116 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.4 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/.tmp/f1/1dc2a18f8ec2471390f951d1c17da617 2017-12-06 22:39:39,117 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/.tmp/f1/d55ab47690a34c658d77071745095951 2017-12-06 22:39:39,152 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741889_1065{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:39:39,153 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741891_1067{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 6372 2017-12-06 22:39:39,153 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741890_1066{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:39:39,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:39,548 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/.tmp/f2/60a5afb07eeb41c5af11bd377c467133 2017-12-06 22:39:39,552 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/.tmp/f2/eb2cf683870f40d0bf846b47add2f5f3 2017-12-06 22:39:39,553 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.4 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/.tmp/f2/8e7579eb72aa48059977accf50a3651f 2017-12-06 22:39:39,559 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/.tmp/f1/87d60f4fe6864703837c3883a9bbca08 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1/87d60f4fe6864703837c3883a9bbca08 2017-12-06 22:39:39,569 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/.tmp/f1/d55ab47690a34c658d77071745095951 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1/d55ab47690a34c658d77071745095951 2017-12-06 22:39:39,569 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/.tmp/f1/1dc2a18f8ec2471390f951d1c17da617 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1/1dc2a18f8ec2471390f951d1c17da617 2017-12-06 22:39:39,572 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1/87d60f4fe6864703837c3883a9bbca08, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:39,574 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/.tmp/f2/60a5afb07eeb41c5af11bd377c467133 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2/60a5afb07eeb41c5af11bd377c467133 2017-12-06 22:39:39,579 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1/d55ab47690a34c658d77071745095951, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:39,579 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1/1dc2a18f8ec2471390f951d1c17da617, entries=21, sequenceid=5, filesize=6.2 K 2017-12-06 22:39:39,581 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/.tmp/f2/eb2cf683870f40d0bf846b47add2f5f3 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2/eb2cf683870f40d0bf846b47add2f5f3 2017-12-06 22:39:39,581 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/.tmp/f2/8e7579eb72aa48059977accf50a3651f as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2/8e7579eb72aa48059977accf50a3651f 2017-12-06 22:39:39,586 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2/60a5afb07eeb41c5af11bd377c467133, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:39,588 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~666 B/666, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. in 892ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:39,590 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:39,591 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:39,592 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2/eb2cf683870f40d0bf846b47add2f5f3, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:39:39,593 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~666 B/666, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. in 898ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:39,594 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:39,595 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2/8e7579eb72aa48059977accf50a3651f, entries=21, sequenceid=5, filesize=6.2 K 2017-12-06 22:39:39,595 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:39,596 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~2.74 KB/2810, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. in 900ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:39,598 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:39,599 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:39,608 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:39,609 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:39,611 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:39,612 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:39,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=70, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=71, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,613 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=70 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234., regionState=CLOSED 2017-12-06 22:39:39,614 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. 2017-12-06 22:39:39,614 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. 2017-12-06 22:39:39,614 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:39,614 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:39,615 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.: disabling compactions & flushes 2017-12-06 22:39:39,616 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:39,616 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=9.03 KB 2017-12-06 22:39:39,616 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.store: f1 2017-12-06 22:39:39,617 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:39,617 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:39,618 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.store: f2 2017-12-06 22:39:39,618 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:39:39,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=72, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,619 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. 2017-12-06 22:39:39,632 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741892_1068{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 9734 2017-12-06 22:39:39,705 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=70, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,705 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=70, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=c045ee6cbe9d5cfbf9869e49fcdf3234, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1460sec 2017-12-06 22:39:39,705 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=72 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0., regionState=CLOSED 2017-12-06 22:39:39,848 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=72, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,849 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=72, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=952d01842eadd6d92f061dc09880e3a0, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.2360sec 2017-12-06 22:39:39,849 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=71 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9., regionState=CLOSED 2017-12-06 22:39:39,901 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=71, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:39,901 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=71, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6e0328adbd37a167dccc80b8dd2b0de9, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.3800sec 2017-12-06 22:39:40,033 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=4.5 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/.tmp/f1/27ddc7d86f4443afb0a621e4e08403ca 2017-12-06 22:39:40,052 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741893_1069{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 9734 2017-12-06 22:39:40,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:40,454 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=4.5 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/.tmp/f2/3703cf8da53e47ccb884d5b63156710f 2017-12-06 22:39:40,464 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/.tmp/f1/27ddc7d86f4443afb0a621e4e08403ca as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1/27ddc7d86f4443afb0a621e4e08403ca 2017-12-06 22:39:40,472 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1/27ddc7d86f4443afb0a621e4e08403ca, entries=69, sequenceid=5, filesize=9.5 K 2017-12-06 22:39:40,474 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/.tmp/f2/3703cf8da53e47ccb884d5b63156710f as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2/3703cf8da53e47ccb884d5b63156710f 2017-12-06 22:39:40,483 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2/3703cf8da53e47ccb884d5b63156710f, entries=69, sequenceid=5, filesize=9.5 K 2017-12-06 22:39:40,484 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~9.03 KB/9246, currentsize=0 B/0 for region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. in 868ms, sequenceid=5, compaction requested=false 2017-12-06 22:39:40,487 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:39:40,488 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:39:40,495 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:39:40,497 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:40,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=69, ppid=68, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:40,498 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=69 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4., regionState=CLOSED 2017-12-06 22:39:40,498 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. 2017-12-06 22:39:40,551 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=69, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:40,592 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=68, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits; resume parent processing. 2017-12-06 22:39:40,593 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=69, ppid=68, state=SUCCESS; UnassignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=5e438ded1a553f64ae16215522e079c4, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 2.0300sec 2017-12-06 22:39:40,593 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599980593}]},"ts":1512599980593} 2017-12-06 22:39:40,597 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to DISABLED in META 2017-12-06 22:39:40,597 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testRecoveryAndDoubleExecutionPreserveSplits, is completed. 2017-12-06 22:39:40,684 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits in 2.3920sec 2017-12-06 22:39:42,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=68 2017-12-06 22:39:42,456 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testRecoveryAndDoubleExecutionPreserveSplits completed 2017-12-06 22:39:42,708 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: true 2017-12-06 22:39:42,751 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=73, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:42,758 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testRecoveryAndDoubleExecutionPreserveSplits' regions in transition 2017-12-06 22:39:42,758 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:42,758 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=73, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:42,758 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:42,758 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:43,001 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 0 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:43,002 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:43,002 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:43,007 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741878_1054{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 30770 2017-12-06 22:39:43,410 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:43,411 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x7316e062 to localhost:49877 2017-12-06 22:39:43,411 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:39:43,412 DEBUG [RS-EventLoopGroup-3-13] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46854. Number of active connections: 2 2017-12-06 22:39:43,415 ERROR [Time-limited test] procedure2.ProcedureExecutor(594): Thread group java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] contains running threads java.lang.ThreadGroup[name=ProcExecThrdGrp,maxpri=10] Thread[ReadOnlyZKClient,5,ProcExecThrdGrp] Thread[ReadOnlyZKClient-SendThread(localhost:49877),5,ProcExecThrdGrp] Thread[ReadOnlyZKClient-EventThread,5,ProcExecThrdGrp] 2017-12-06 22:39:43,416 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:43,416 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:43,416 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:43,418 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:43,419 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:43,419 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,424 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:43,425 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 0ms 2017-12-06 22:39:43,425 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,430 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:43,431 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 0ms 2017-12-06 22:39:43,431 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,436 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:43,437 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:43,437 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,441 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:43,442 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:43,442 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,446 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:43,447 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:43,447 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,450 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:43,451 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:43,451 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,455 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:43,456 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 1ms 2017-12-06 22:39:43,456 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,460 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:43,461 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 1ms 2017-12-06 22:39:43,461 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,465 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log 2017-12-06 22:39:43,465 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log after 0ms 2017-12-06 22:39:43,466 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log; isDirectory=false; length=30770; replication=1; blocksize=134217728; modification_time=1512599983408; access_time=1512599970410; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:43,471 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 11 2017-12-06 22:39:43,472 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 11 2017-12-06 22:39:43,472 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 56msec 2017-12-06 22:39:43,496 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=73 2017-12-06 22:39:43,496 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:43,497 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:43,497 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:43,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:43,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:43,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:43,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:43,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:43,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:43,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:43,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:43,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:43,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:43,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:43,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:43,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:43,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:43,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:43,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:43,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:43,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:43,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=73, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:43,505 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 32msec 2017-12-06 22:39:43,505 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600013505 2017-12-06 22:39:43,505 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:43,507 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=73, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:43,590 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=74, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,590 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=74 2017-12-06 22:39:43,591 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=74, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:43,596 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:43,659 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=74, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:43,660 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=75, ppid=74, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:43,696 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=75, ppid=74, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:43,696 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=75, ppid=74, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:43,848 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=75, ppid=74, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:44,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=75, ppid=74, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,296 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599984296}]},"ts":1512599984296} 2017-12-06 22:39:44,300 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:44,300 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,367 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=75, ppid=74, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,425 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=74, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:44,425 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=75, ppid=74, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 664msec 2017-12-06 22:39:44,492 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=74, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 919msec 2017-12-06 22:39:44,494 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,497 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:44,502 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:44,502 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:44,508 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,509 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 5e438ded1a553f64ae16215522e079c4, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.', STARTKEY => '', ENDKEY => 'a'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,509 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => c045ee6cbe9d5cfbf9869e49fcdf3234, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.', STARTKEY => 'a', ENDKEY => 'b'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,509 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 6e0328adbd37a167dccc80b8dd2b0de9, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.', STARTKEY => 'b', ENDKEY => 'c'} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 952d01842eadd6d92f061dc09880e3a0, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.', STARTKEY => 'c', ENDKEY => ''} regionState=CLOSED lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:44,510 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599989510 2017-12-06 22:39:44,510 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 8msec, failover=false 2017-12-06 22:39:44,514 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testRecoveryAndDoubleExecutionPreserveSplits' regions in transition 2017-12-06 22:39:44,514 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:44,576 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984575}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984575}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984575}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984575}]},"ts":9223372036854775807} 2017-12-06 22:39:44,581 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:44,584 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 5e438ded1a553f64ae16215522e079c4, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => c045ee6cbe9d5cfbf9869e49fcdf3234, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => 6e0328adbd37a167dccc80b8dd2b0de9, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 952d01842eadd6d92f061dc09880e3a0, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:44,587 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testRecoveryAndDoubleExecutionPreserveSplits' from region states. 2017-12-06 22:39:44,587 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984587}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984587}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984587}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599984587}]},"ts":9223372036854775807} 2017-12-06 22:39:44,601 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:44,601 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 5e438ded1a553f64ae16215522e079c4, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => c045ee6cbe9d5cfbf9869e49fcdf3234, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => 6e0328adbd37a167dccc80b8dd2b0de9, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 952d01842eadd6d92f061dc09880e3a0, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:44,602 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testRecoveryAndDoubleExecutionPreserveSplits' as deleted. 2017-12-06 22:39:44,602 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599984602}]},"ts":9223372036854775807} 2017-12-06 22:39:44,605 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testRecoveryAndDoubleExecutionPreserveSplits state from META 2017-12-06 22:39:44,605 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:44,605 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=73, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:44,605 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:44,605 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:44,761 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 1 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:44,761 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:44,761 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:44,765 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741894_1070{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 2683 2017-12-06 22:39:45,118 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:39:45,167 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:45,168 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:45,168 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:45,169 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:45,170 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:45,171 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:45,171 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,176 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:45,177 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:45,177 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,180 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:45,181 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:45,181 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,185 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:45,186 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:45,186 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,189 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:45,190 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:45,190 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,193 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:45,194 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 0ms 2017-12-06 22:39:45,194 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,198 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:45,198 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 0ms 2017-12-06 22:39:45,198 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,201 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:45,202 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 0ms 2017-12-06 22:39:45,203 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,206 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:45,207 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 1ms 2017-12-06 22:39:45,207 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,210 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log 2017-12-06 22:39:45,211 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log after 1ms 2017-12-06 22:39:45,211 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log; isDirectory=false; length=30770; replication=1; blocksize=134217728; modification_time=1512599983408; access_time=1512599970410; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,215 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log 2017-12-06 22:39:45,216 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log after 1ms 2017-12-06 22:39:45,216 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log; isDirectory=false; length=2683; replication=1; blocksize=134217728; modification_time=1512599985166; access_time=1512599983470; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:45,223 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 12 2017-12-06 22:39:45,224 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 12 2017-12-06 22:39:45,224 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 55msec 2017-12-06 22:39:45,251 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=75 2017-12-06 22:39:45,252 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=74, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,253 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:45,254 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:45,254 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:45,254 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:45,254 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:45,255 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,255 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,255 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,255 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,256 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:45,257 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,257 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,257 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,257 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,258 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,258 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:45,259 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:45,259 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:45,259 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:45,260 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:45,260 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:45,260 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:45,261 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:45,262 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:45,262 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:45,262 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:45,263 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:45,263 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:45,263 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:45,263 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:45,264 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,264 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=73, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:45,264 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 40msec 2017-12-06 22:39:45,265 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600015265 2017-12-06 22:39:45,266 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=73, state=RUNNABLE:TRUNCATE_TABLE_REMOVE_FROM_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:45,266 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:45,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=null, table=hbase:meta, region=1588230740 2017-12-06 22:39:45,298 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(953): META REPORTED but no procedure found (complete?) 2017-12-06 22:39:45,334 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=76, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,334 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=76 2017-12-06 22:39:45,335 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=76, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:45,339 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:45,393 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=76, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:45,394 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:45,443 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=77, ppid=76, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:45,443 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=77, ppid=76, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=true 2017-12-06 22:39:45,596 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:45,609 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=77, ppid=76, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:45,759 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:45,761 WARN [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1886): Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2017-12-06 22:39:46,180 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:39:46,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:46,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=77, ppid=76, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:46,301 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599986301}]},"ts":1512599986301} 2017-12-06 22:39:46,305 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:46,305 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:46,376 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=77, ppid=76, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:46,426 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=76, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:46,426 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=77, ppid=76, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 923msec 2017-12-06 22:39:46,476 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=76, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.1590sec 2017-12-06 22:39:46,477 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:46,481 WARN [Time-limited test] master.TableStateManager(218): Found table with no state, assuming ENABLED 2017-12-06 22:39:46,481 DEBUG [Time-limited test] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599986481}]},"ts":1512599986481} 2017-12-06 22:39:46,484 INFO [Time-limited test] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to ENABLED in META 2017-12-06 22:39:46,485 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:46,489 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:46,489 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:46,494 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:46,494 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:46,494 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:46,495 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:46,495 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:46,495 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599991495 2017-12-06 22:39:46,495 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 6msec, failover=false 2017-12-06 22:39:46,496 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599986495}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599986495}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599986495}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512599986495}]},"ts":9223372036854775807} 2017-12-06 22:39:46,503 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:39:46,504 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 5e438ded1a553f64ae16215522e079c4, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => c045ee6cbe9d5cfbf9869e49fcdf3234, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => 6e0328adbd37a167dccc80b8dd2b0de9, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 952d01842eadd6d92f061dc09880e3a0, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:39:46,507 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testRecoveryAndDoubleExecutionPreserveSplits' from region states. 2017-12-06 22:39:46,507 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): 2017-12-06 22:39:46,507 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 0 regions from META 2017-12-06 22:39:46,507 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [] 2017-12-06 22:39:46,508 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testRecoveryAndDoubleExecutionPreserveSplits' as deleted. 2017-12-06 22:39:46,508 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512599986508}]},"ts":9223372036854775807} 2017-12-06 22:39:46,511 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testRecoveryAndDoubleExecutionPreserveSplits state from META 2017-12-06 22:39:46,511 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:46,581 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. from FS 2017-12-06 22:39:46,581 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:46,586 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits] 2017-12-06 22:39:46,610 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1/27ddc7d86f4443afb0a621e4e08403ca, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1/27ddc7d86f4443afb0a621e4e08403ca 2017-12-06 22:39:46,617 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2/3703cf8da53e47ccb884d5b63156710f, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2/3703cf8da53e47ccb884d5b63156710f 2017-12-06 22:39:46,624 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits/8.seqid 2017-12-06 22:39:46,625 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741882_1058 127.0.0.1:55766 2017-12-06 22:39:46,626 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:46,626 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. from FS 2017-12-06 22:39:46,626 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:46,630 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits] 2017-12-06 22:39:46,638 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1/d55ab47690a34c658d77071745095951, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1/d55ab47690a34c658d77071745095951 2017-12-06 22:39:46,660 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2/eb2cf683870f40d0bf846b47add2f5f3, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2/eb2cf683870f40d0bf846b47add2f5f3 2017-12-06 22:39:46,667 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits/8.seqid 2017-12-06 22:39:46,668 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:55766 2017-12-06 22:39:46,669 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:46,669 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. from FS 2017-12-06 22:39:46,669 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:46,673 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits] 2017-12-06 22:39:46,682 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1/87d60f4fe6864703837c3883a9bbca08, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1/87d60f4fe6864703837c3883a9bbca08 2017-12-06 22:39:46,688 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2/60a5afb07eeb41c5af11bd377c467133, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2/60a5afb07eeb41c5af11bd377c467133 2017-12-06 22:39:46,710 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits/8.seqid 2017-12-06 22:39:46,711 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741885_1061 127.0.0.1:55766 2017-12-06 22:39:46,712 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:46,712 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. from FS 2017-12-06 22:39:46,712 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:46,717 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits] 2017-12-06 22:39:46,725 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1/1dc2a18f8ec2471390f951d1c17da617, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1/1dc2a18f8ec2471390f951d1c17da617 2017-12-06 22:39:46,744 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2/8e7579eb72aa48059977accf50a3651f, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2/8e7579eb72aa48059977accf50a3651f 2017-12-06 22:39:46,750 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits/8.seqid 2017-12-06 22:39:46,752 INFO [IPC Server handler 8 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:55766 2017-12-06 22:39:46,752 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:46,752 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testRecoveryAndDoubleExecutionPreserveSplits' archived! 2017-12-06 22:39:46,754 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741881_1057 127.0.0.1:55766 2017-12-06 22:39:46,755 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:46,755 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=73, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:46,755 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:46,755 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:46,996 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 2 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:46,996 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:46,996 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:47,001 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741895_1071{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 3628 2017-12-06 22:39:47,403 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:47,403 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:47,404 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:47,404 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:47,407 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:47,408 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:47,408 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,413 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:47,414 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:47,414 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,418 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:47,419 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:47,419 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,423 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:47,424 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:47,424 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,428 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:47,428 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 0ms 2017-12-06 22:39:47,429 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,432 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:47,433 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 0ms 2017-12-06 22:39:47,434 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,438 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:47,439 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 0ms 2017-12-06 22:39:47,439 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,444 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:47,445 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 1ms 2017-12-06 22:39:47,445 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,449 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:47,450 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 1ms 2017-12-06 22:39:47,450 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,453 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log 2017-12-06 22:39:47,454 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log after 1ms 2017-12-06 22:39:47,454 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log; isDirectory=false; length=30770; replication=1; blocksize=134217728; modification_time=1512599983408; access_time=1512599970410; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,457 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log 2017-12-06 22:39:47,458 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log after 1ms 2017-12-06 22:39:47,458 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log; isDirectory=false; length=2683; replication=1; blocksize=134217728; modification_time=1512599985166; access_time=1512599983470; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,461 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log 2017-12-06 22:39:47,462 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log after 1ms 2017-12-06 22:39:47,462 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log; isDirectory=false; length=3628; replication=1; blocksize=134217728; modification_time=1512599987402; access_time=1512599985221; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:47,467 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 13 2017-12-06 22:39:47,469 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 13 2017-12-06 22:39:47,469 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 65msec 2017-12-06 22:39:47,496 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=77 2017-12-06 22:39:47,497 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=76, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=74, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,498 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,499 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:47,500 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,501 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:47,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,502 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,503 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,504 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:47,505 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,505 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,506 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:47,506 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,506 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,507 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:47,507 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:47,507 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:47,507 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:47,508 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:47,508 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:47,508 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:47,508 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,508 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=73, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:47,509 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 40msec 2017-12-06 22:39:47,509 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600017509 2017-12-06 22:39:47,510 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:47,511 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=73, state=RUNNABLE:TRUNCATE_TABLE_CLEAR_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:47,576 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=78, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,577 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=78 2017-12-06 22:39:47,578 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=78, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:47,583 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:47,635 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=78, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:47,636 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=79, ppid=78, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:47,650 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1059 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:39:47,653 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:39:47,654 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1060 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:39:47,655 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:39:47,655 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:39:47,656 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:39:47,656 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:39:47,656 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1061 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:39:47,656 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:39:47,657 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:39:47,657 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:39:47,658 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:39:47,676 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=79, ppid=78, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:47,677 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=79, ppid=78, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:47,693 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:39:47,694 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:39:47,696 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:39:47,697 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:39:47,697 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:39:47,698 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:39:47,698 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:39:47,698 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:39:47,698 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:39:47,699 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:39:47,699 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,699 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:39:47,700 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:47,701 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:39:47,703 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:47,704 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:47,704 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:47,706 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:47,706 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:47,707 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:47,707 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:39:47,707 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:47,707 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:39:47,708 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:39:47,709 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:47,709 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:47,711 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:39:47,712 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 with reasons: undeletable, please check. 2017-12-06 22:39:47,713 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:39:47,713 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable with reasons: undeletable, please check. 2017-12-06 22:39:47,713 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:39:47,713 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,714 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:47,714 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:39:47,714 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:39:47,715 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:47,716 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:39:47,716 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:47,717 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:47,717 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:47,719 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:47,719 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:39:47,719 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:39:47,718 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:39:47,719 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:39:47,720 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:39:47,721 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:47,721 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:47,721 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:47,722 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:47,722 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,722 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:39:47,722 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:39:47,723 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:39:47,723 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:39:47,723 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:39:47,724 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,724 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:47,725 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:39:47,725 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:39:47,725 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:39:47,725 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:39:47,726 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,726 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:47,726 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:39:47,727 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:39:47,727 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:39:47,727 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:39:47,728 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,728 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:47,728 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:39:47,729 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:39:47,728 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:47,729 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:47,730 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,730 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:39:47,730 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:47,730 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:39:47,731 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff with reasons: undeletable, please check. 2017-12-06 22:39:47,730 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:47,731 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:39:47,731 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,732 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:39:47,732 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:39:47,732 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 with reasons: undeletable, please check. 2017-12-06 22:39:47,733 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1067 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:39:47,733 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:47,733 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 with reasons: undeletable, please check. 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:39:47,734 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:39:47,735 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:47,735 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:47,735 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,735 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:47,735 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:47,736 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:39:47,736 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:47,736 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:39:47,737 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,737 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:47,737 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:39:47,737 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:39:47,737 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:47,738 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:39:47,739 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:39:47,740 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,740 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:39:47,740 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:39:47,740 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1067 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:39:47,740 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f with reasons: undeletable, please check. 2017-12-06 22:39:47,741 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:39:47,742 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:39:47,743 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:39:47,743 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:47,743 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:47,744 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,744 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:39:47,744 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:39:47,744 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 with reasons: undeletable, please check. 2017-12-06 22:39:47,744 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:39:47,745 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:39:47,745 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,746 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:39:47,750 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1067 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:39:47,747 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,750 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:39:47,750 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:39:47,749 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:47,748 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:39:47,751 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:39:47,750 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:39:47,751 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:39:47,751 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:39:47,751 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:39:47,752 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 with reasons: undeletable, please check. 2017-12-06 22:39:47,753 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:39:47,754 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:39:47,754 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:39:47,755 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,755 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:47,755 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:39:47,755 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:39:47,755 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:39:47,756 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:39:47,756 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:39:47,756 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:39:47,758 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:47,758 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:47,761 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,761 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:47,761 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:39:47,761 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:39:47,763 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,763 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:39:47,763 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:39:47,764 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:39:47,764 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:39:47,765 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,765 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:47,765 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:39:47,766 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1064 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:39:47,767 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,767 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:39:47,767 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:39:47,767 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:39:47,768 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:39:47,768 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:39:47,769 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:39:47,770 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 with reasons: undeletable, please check. 2017-12-06 22:39:47,770 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1067 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:39:47,771 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,771 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:39:47,771 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:39:47,771 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:47,771 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 with reasons: undeletable, please check. 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:47,773 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1069 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:39:47,775 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1070 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:39:47,774 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,775 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:39:47,775 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:47,775 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 with reasons: undeletable, please check. 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:47,776 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1066 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:47,777 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 with reasons: undeletable, please check. 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1063 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1068 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:47,778 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:39:47,779 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1069 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:39:47,779 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1067 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:39:47,779 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:47,779 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:39:47,780 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1070 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:39:47,781 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,782 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:47,782 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:39:47,782 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:39:47,782 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1062 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:39:47,782 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:39:47,783 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:39:47,783 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,783 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:39:47,783 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:39:47,783 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:39:47,784 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c with reasons: undeletable, please check. 2017-12-06 22:39:47,784 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1065 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:47,788 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1069 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:39:47,790 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,790 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:47,790 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:39:47,790 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:39:47,790 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:39:47,791 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,792 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:47,792 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:39:47,793 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 with reasons: undeletable, please check. 2017-12-06 22:39:47,793 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:47,793 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:39:47,795 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,795 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:39:47,795 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:39:47,797 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 with reasons: undeletable, please check. 2017-12-06 22:39:47,797 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:47,797 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:39:47,797 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 with reasons: undeletable, please check. 2017-12-06 22:39:47,798 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:39:47,799 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,799 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:39:47,799 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:39:47,799 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 with reasons: undeletable, please check. 2017-12-06 22:39:47,801 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:39:47,801 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:39:47,801 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:39:47,801 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 with reasons: undeletable, please check. 2017-12-06 22:39:47,801 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:39:47,802 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:39:47,803 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:39:47,803 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:39:47,803 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:39:47,806 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1059 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:39:47,807 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,807 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,808 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,808 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,808 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,808 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:39:47,808 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:39:47,828 INFO [ProcExecWrkr-1] assignment.AssignProcedure(236): Early suspend! pid=79, ppid=78, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:47,901 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741881_1057, blk_1073741882_1058, blk_1073741883_1059, blk_1073741884_1060, blk_1073741885_1061] 2017-12-06 22:39:48,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:48,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=79, ppid=78, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:48,308 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599988307}]},"ts":1512599988307} 2017-12-06 22:39:48,312 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:48,312 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:48,426 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=79, ppid=78, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:48,485 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=78, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:48,485 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=79, ppid=78, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 752msec 2017-12-06 22:39:48,543 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=78, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 973msec 2017-12-06 22:39:48,544 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:48,548 WARN [Time-limited test] master.TableStateManager(218): Found table with no state, assuming ENABLED 2017-12-06 22:39:48,548 DEBUG [Time-limited test] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599988548}]},"ts":1512599988548} 2017-12-06 22:39:48,552 INFO [Time-limited test] hbase.MetaTableAccessor(1770): Updated table testRecoveryAndDoubleExecutionPreserveSplits state to ENABLED in META 2017-12-06 22:39:48,552 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:48,556 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:48,556 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:48,561 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:48,562 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:48,562 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:48,562 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:48,562 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:48,562 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599993562 2017-12-06 22:39:48,563 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 7msec, failover=false 2017-12-06 22:39:48,564 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,,1512599975878.5e438ded1a553f64ae16215522e079c4. from FS 2017-12-06 22:39:48,564 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:48,565 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 empty. 2017-12-06 22:39:48,567 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:39:48,567 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599975878.c045ee6cbe9d5cfbf9869e49fcdf3234. from FS 2017-12-06 22:39:48,567 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:48,568 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 empty. 2017-12-06 22:39:48,569 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:39:48,569 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599975878.6e0328adbd37a167dccc80b8dd2b0de9. from FS 2017-12-06 22:39:48,569 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:48,570 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 empty. 2017-12-06 22:39:48,570 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:39:48,570 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599975878.952d01842eadd6d92f061dc09880e3a0. from FS 2017-12-06 22:39:48,571 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:48,572 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(149): Region directory hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 empty. 2017-12-06 22:39:48,572 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(469): Failed to delete region directory:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:39:48,572 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testRecoveryAndDoubleExecutionPreserveSplits' archived! 2017-12-06 22:39:48,575 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:48,635 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741897_1073{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 999 2017-12-06 22:39:48,827 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:39:49,041 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:49,044 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:49,045 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:49,045 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:49,046 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:49,063 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741899_1075{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 80 2017-12-06 22:39:49,065 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741898_1074{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:49,065 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741901_1077{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:49,066 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741900_1076{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 80 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d.: disabling compactions & flushes 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978.: disabling compactions & flushes 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:49,465 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:49,465 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:49,465 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:49,466 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:49,466 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c.: disabling compactions & flushes 2017-12-06 22:39:49,466 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:49,467 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:49,466 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:49,467 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.: disabling compactions & flushes 2017-12-06 22:39:49,467 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:49,467 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:49,470 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:49,470 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=73, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:49,470 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:49,471 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:49,563 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 3 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:49,563 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:49,564 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:49,568 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741896_1072{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 3633 2017-12-06 22:39:49,970 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:49,970 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:49,971 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:49,971 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:49,972 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:49,973 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:49,973 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,977 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:49,977 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 0ms 2017-12-06 22:39:49,978 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,980 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:49,981 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 0ms 2017-12-06 22:39:49,981 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,986 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:49,987 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:49,987 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,990 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:49,991 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:49,991 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,994 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:49,995 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 1ms 2017-12-06 22:39:49,995 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:49,999 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:50,000 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:50,000 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,004 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:50,005 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 1ms 2017-12-06 22:39:50,005 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,008 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:50,009 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 0ms 2017-12-06 22:39:50,009 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,013 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log 2017-12-06 22:39:50,013 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log after 0ms 2017-12-06 22:39:50,014 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log; isDirectory=false; length=30770; replication=1; blocksize=134217728; modification_time=1512599983408; access_time=1512599970410; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,018 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log 2017-12-06 22:39:50,019 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log after 1ms 2017-12-06 22:39:50,019 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log; isDirectory=false; length=2683; replication=1; blocksize=134217728; modification_time=1512599985166; access_time=1512599983470; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,022 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log 2017-12-06 22:39:50,023 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log after 1ms 2017-12-06 22:39:50,023 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log; isDirectory=false; length=3628; replication=1; blocksize=134217728; modification_time=1512599987402; access_time=1512599985221; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,026 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log 2017-12-06 22:39:50,027 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log after 1ms 2017-12-06 22:39:50,027 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log; isDirectory=false; length=3633; replication=1; blocksize=134217728; modification_time=1512599989969; access_time=1512599987466; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:50,033 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 14 2017-12-06 22:39:50,034 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 14 2017-12-06 22:39:50,034 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 63msec 2017-12-06 22:39:50,061 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=79 2017-12-06 22:39:50,062 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=78, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,062 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=76, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,063 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=74, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,063 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,063 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,064 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:50,064 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:50,064 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:50,065 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,065 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,065 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,065 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,065 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:50,066 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,066 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,066 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,066 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,067 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,067 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:50,067 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:50,068 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:50,069 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:50,069 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:50,069 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:50,069 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:50,070 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:50,070 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:50,070 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:50,071 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:50,071 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:50,071 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:50,071 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:50,072 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:50,072 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,072 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=73, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:50,072 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 38msec 2017-12-06 22:39:50,073 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600020073 2017-12-06 22:39:50,073 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:50,075 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=73, state=RUNNABLE:TRUNCATE_TABLE_CREATE_FS_LAYOUT; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:50,133 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=80, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,133 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=80 2017-12-06 22:39:50,134 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=80, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:50,138 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:50,174 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=80, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,174 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:50,215 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=81, ppid=80, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:50,215 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=81, ppid=80, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:50,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:50,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=81, ppid=80, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,314 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599990314}]},"ts":1512599990314} 2017-12-06 22:39:50,319 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:50,319 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,398 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=81, ppid=80, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,456 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=80, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:50,457 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=81, ppid=80, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 160msec 2017-12-06 22:39:50,498 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=80, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 382msec 2017-12-06 22:39:50,499 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,503 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:50,506 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:50,506 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:50,511 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:50,512 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:50,512 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 0msec 2017-12-06 22:39:50,512 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:50,512 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 0msec 2017-12-06 22:39:50,512 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599995512 2017-12-06 22:39:50,512 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 6msec, failover=false 2017-12-06 22:39:50,523 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741903_1079{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 999 2017-12-06 22:39:50,672 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:39:50,928 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testRecoveryAndDoubleExecutionPreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:39:50,931 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,931 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,931 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,932 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(6731): creating HRegion testRecoveryAndDoubleExecutionPreserveSplits HTD == 'testRecoveryAndDoubleExecutionPreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:50,942 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741904_1080{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 80 2017-12-06 22:39:50,942 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741905_1081{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:50,943 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741906_1082{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 80 2017-12-06 22:39:50,943 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741907_1083{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 81 2017-12-06 22:39:51,343 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:51,343 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:51,344 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.: disabling compactions & flushes 2017-12-06 22:39:51,344 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:51,344 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-2] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:51,344 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d.: disabling compactions & flushes 2017-12-06 22:39:51,344 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:51,344 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-4] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d. 2017-12-06 22:39:51,345 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:51,345 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c.: disabling compactions & flushes 2017-12-06 22:39:51,344 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:51,345 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:51,345 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978.: disabling compactions & flushes 2017-12-06 22:39:51,345 DEBUG [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:51,345 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:51,345 INFO [RegionOpenAndInitThread-testRecoveryAndDoubleExecutionPreserveSplits-3] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c. 2017-12-06 22:39:51,347 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:55766 2017-12-06 22:39:51,347 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741900_1076 127.0.0.1:55766 2017-12-06 22:39:51,347 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741901_1077 127.0.0.1:55766 2017-12-06 22:39:51,348 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:55766 2017-12-06 22:39:51,348 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:55766 2017-12-06 22:39:51,349 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:51,400 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d.","families":{"info":[{"qualifier":"regioninfo","vlen":79,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978.","families":{"info":[{"qualifier":"regioninfo","vlen":79,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:39:51,405 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:39:51,405 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: false 2017-12-06 22:39:51,405 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1517): TESTING: Kill before store update: pid=73, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:51,405 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:39:51,405 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:39:51,513 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 4 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_ASSIGN_REGIONS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:51,514 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:39:51,514 INFO [Time-limited test] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:39:51,518 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741902_1078{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 3404 2017-12-06 22:39:51,920 INFO [Time-limited test] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:39:51,920 INFO [Time-limited test] procedure2.ProcedureTestingUtility(99): RESTART - Start 2017-12-06 22:39:51,921 INFO [Time-limited test] procedure2.ProcedureExecutor(512): Starting ProcedureExecutor Worker threads (ProcExecWrkr)=1 2017-12-06 22:39:51,921 INFO [Time-limited test] wal.WALProcedureStore(358): Starting WAL Procedure Store lease recovery 2017-12-06 22:39:51,922 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log 2017-12-06 22:39:51,923 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log after 1ms 2017-12-06 22:39:51,923 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000001.log; isDirectory=false; length=89385; replication=1; blocksize=134217728; modification_time=1512599954339; access_time=1512599927589; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,928 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log 2017-12-06 22:39:51,929 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log after 1ms 2017-12-06 22:39:51,929 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000002.log; isDirectory=false; length=2681; replication=1; blocksize=134217728; modification_time=1512599956108; access_time=1512599954374; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,932 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log 2017-12-06 22:39:51,933 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log after 1ms 2017-12-06 22:39:51,933 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000003.log; isDirectory=false; length=3627; replication=1; blocksize=134217728; modification_time=1512599958331; access_time=1512599956125; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,937 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log 2017-12-06 22:39:51,938 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log after 1ms 2017-12-06 22:39:51,938 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000004.log; isDirectory=false; length=3391; replication=1; blocksize=134217728; modification_time=1512599960369; access_time=1512599958355; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,942 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log 2017-12-06 22:39:51,943 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log after 1ms 2017-12-06 22:39:51,943 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000005.log; isDirectory=false; length=3395; replication=1; blocksize=134217728; modification_time=1512599962804; access_time=1512599960396; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,946 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log 2017-12-06 22:39:51,947 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log after 0ms 2017-12-06 22:39:51,948 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000006.log; isDirectory=false; length=3013; replication=1; blocksize=134217728; modification_time=1512599964415; access_time=1512599962837; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,951 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log 2017-12-06 22:39:51,952 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log after 1ms 2017-12-06 22:39:51,952 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000007.log; isDirectory=false; length=3400; replication=1; blocksize=134217728; modification_time=1512599966092; access_time=1512599964456; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,957 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log 2017-12-06 22:39:51,958 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log after 1ms 2017-12-06 22:39:51,958 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000008.log; isDirectory=false; length=2618; replication=1; blocksize=134217728; modification_time=1512599968050; access_time=1512599966134; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,962 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log 2017-12-06 22:39:51,962 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log after 0ms 2017-12-06 22:39:51,962 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000009.log; isDirectory=false; length=2625; replication=1; blocksize=134217728; modification_time=1512599970355; access_time=1512599968101; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,966 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log 2017-12-06 22:39:51,968 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log after 1ms 2017-12-06 22:39:51,968 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000010.log; isDirectory=false; length=30770; replication=1; blocksize=134217728; modification_time=1512599983408; access_time=1512599970410; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,972 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log 2017-12-06 22:39:51,973 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log after 1ms 2017-12-06 22:39:51,973 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000011.log; isDirectory=false; length=2683; replication=1; blocksize=134217728; modification_time=1512599985166; access_time=1512599983470; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,976 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log 2017-12-06 22:39:51,977 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log after 1ms 2017-12-06 22:39:51,977 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000012.log; isDirectory=false; length=3628; replication=1; blocksize=134217728; modification_time=1512599987402; access_time=1512599985221; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,980 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log 2017-12-06 22:39:51,981 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log after 1ms 2017-12-06 22:39:51,981 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000013.log; isDirectory=false; length=3633; replication=1; blocksize=134217728; modification_time=1512599989969; access_time=1512599987466; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,984 INFO [Time-limited test] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000014.log 2017-12-06 22:39:51,985 INFO [Time-limited test] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000014.log after 1ms 2017-12-06 22:39:51,985 DEBUG [Time-limited test] wal.WALProcedureStore(1282): Opening Pv2 FileStatus{path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/MasterProcWALs/pv2-00000000000000000014.log; isDirectory=false; length=3404; replication=1; blocksize=134217728; modification_time=1512599991919; access_time=1512599990032; owner=jenkins; group=supergroup; permission=rw-r--r--; isSymlink=false} 2017-12-06 22:39:51,990 DEBUG [Time-limited test] wal.WALProcedureStore(1067): Roll new state log: 15 2017-12-06 22:39:51,992 INFO [Time-limited test] wal.WALProcedureStore(387): Lease acquired for flushLogId: 15 2017-12-06 22:39:51,992 INFO [Time-limited test] procedure2.ProcedureExecutor(533): Recover store (WALProcedureStore) lease: 71msec 2017-12-06 22:39:52,022 DEBUG [Time-limited test] procedure2.ProcedureExecutor$1(316): Load max pid=81 2017-12-06 22:39:52,023 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=80, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,023 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=78, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,024 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=76, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,024 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=74, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,024 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=68, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:52,025 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:39:52,025 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:52,025 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=60, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:52,026 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=39, state=SUCCESS; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:52,026 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=58, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,026 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=56, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,026 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=53, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=51, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=50, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits, region=afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=48, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=46, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=44, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,027 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=42, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,028 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=40, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,028 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=34, state=SUCCESS; DisableTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:52,028 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=29, state=SUCCESS; CreateTableProcedure table=testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:39:52,029 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=28, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotFoundException via master-truncate-table:org.apache.hadoop.hbase.TableNotFoundException: testTruncateNotExistentTable; TruncateTableProcedure (table=testTruncateNotExistentTable preserveSplits=true) 2017-12-06 22:39:52,029 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=27, state=SUCCESS; DeleteTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:52,029 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=25, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:52,029 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=23, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncateNoPreserveSplits preserveSplits=false) 2017-12-06 22:39:52,029 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=18, state=SUCCESS; DisableTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:52,030 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=13, state=SUCCESS; CreateTableProcedure table=testSimpleTruncateNoPreserveSplits 2017-12-06 22:39:52,030 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=12, state=SUCCESS; DeleteTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:52,030 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=10, state=SUCCESS; DisableTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:52,031 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=9, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableNotDisabledException via master-truncate-table:org.apache.hadoop.hbase.TableNotDisabledException: testTruncateNotDisabledTable; TruncateTableProcedure (table=testTruncateNotDisabledTable preserveSplits=false) 2017-12-06 22:39:52,031 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=7, state=SUCCESS; CreateTableProcedure table=testTruncateNotDisabledTable 2017-12-06 22:39:52,031 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2017-12-06 22:39:52,031 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2017-12-06 22:39:52,032 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2017-12-06 22:39:52,032 DEBUG [Time-limited test] procedure2.ProcedureExecutor(355): Completed pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,032 DEBUG [Time-limited test] procedure2.ProcedureExecutor(392): Loading pid=73, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:52,032 INFO [Time-limited test] procedure2.ProcedureExecutor(547): Load store (WALProcedureStore): 40msec 2017-12-06 22:39:52,033 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1512600022033 2017-12-06 22:39:52,033 INFO [Time-limited test] assignment.AssignmentManager(215): Starting assignment manager 2017-12-06 22:39:52,034 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor(1230): LOCK_EVENT_WAIT pid=73, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:39:52,109 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=82, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,109 INFO [Time-limited test] master.HMaster(3522): Waiting on RecoverMetaProcedure submitted with procId=82 2017-12-06 22:39:52,110 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(106): Start pid=82, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2017-12-06 22:39:52,114 INFO [ProcExecWrkr-1] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:52,164 INFO [ProcExecWrkr-1] procedure.RecoverMetaProcedure(137): pid=82, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,164 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:39:52,213 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=83, ppid=82, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 hbase:meta hbase:meta,,1.1588230740 2017-12-06 22:39:52,213 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=83, ppid=82, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033; forceNewPlan=false, retain=false 2017-12-06 22:39:52,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.AssignmentManager(951): META REPORTED: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=hbase:meta, region=1588230740 2017-12-06 22:39:52,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=0, pid=83, ppid=82, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033; rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,321 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"hbase:meta","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512599992321}]},"ts":1512599992321} 2017-12-06 22:39:52,325 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table hbase:meta state to ENABLED in META 2017-12-06 22:39:52,325 INFO [ProcExecWrkr-1] zookeeper.MetaTableLocator(447): Setting hbase:meta (replicaId=0) location in ZooKeeper as asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,396 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=83, ppid=82, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,438 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=82, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2017-12-06 22:39:52,438 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=83, ppid=82, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740, target=asf911.gq1.ygridcore.net,43202,1512599926033 in 178msec 2017-12-06 22:39:52,482 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=82, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 403msec 2017-12-06 22:39:52,483 INFO [Time-limited test] master.HMaster(3524): Default replica of hbase:meta, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,487 DEBUG [Time-limited test] master.ServerManager(658): AssignmentManager failover cleanup not done. 2017-12-06 22:39:52,489 INFO [Time-limited test] master.MasterWalManager(190): Log folder hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 belongs to an existing region server 2017-12-06 22:39:52,490 INFO [Time-limited test] assignment.AssignmentManager(1156): Joining the cluster... 2017-12-06 22:39:52,499 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 98664e5c7a903927b03ac89fe21a8d2d, NAME => 'hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.', STARTKEY => '', ENDKEY => ''} regionState=OPEN lastHost=asf911.gq1.ygridcore.net,43202,1512599926033 regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,500 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 6190bf675a14a1eedcf58368d0992978, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978.', STARTKEY => '', ENDKEY => 'a'} regionState=null lastHost=null regionLocation=null 2017-12-06 22:39:52,500 INFO [Time-limited test] assignment.AssignmentManager$1(1191): 6190bf675a14a1eedcf58368d0992978 state=null; presuming OFFLINE 2017-12-06 22:39:52,500 INFO [Time-limited test] assignment.RegionStates(852): Added to offline, CURRENTLY NEVER CLEARED!!! rit=OFFLINE, location=null, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:39:52,500 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 84d67cd4b84b3eb223bc0ffdc96e8e5e, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.', STARTKEY => 'a', ENDKEY => 'b'} regionState=null lastHost=null regionLocation=null 2017-12-06 22:39:52,500 INFO [Time-limited test] assignment.AssignmentManager$1(1191): 84d67cd4b84b3eb223bc0ffdc96e8e5e state=null; presuming OFFLINE 2017-12-06 22:39:52,501 INFO [Time-limited test] assignment.RegionStates(852): Added to offline, CURRENTLY NEVER CLEARED!!! rit=OFFLINE, location=null, table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e 2017-12-06 22:39:52,501 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => a250ba3efe61b8e8cd2d45a24dbf1b9c, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,b,1512599988575.a250ba3efe61b8e8cd2d45a24dbf1b9c.', STARTKEY => 'b', ENDKEY => 'c'} regionState=null lastHost=null regionLocation=null 2017-12-06 22:39:52,501 INFO [Time-limited test] assignment.AssignmentManager$1(1191): a250ba3efe61b8e8cd2d45a24dbf1b9c state=null; presuming OFFLINE 2017-12-06 22:39:52,502 INFO [Time-limited test] assignment.RegionStates(852): Added to offline, CURRENTLY NEVER CLEARED!!! rit=OFFLINE, location=null, table=testRecoveryAndDoubleExecutionPreserveSplits, region=a250ba3efe61b8e8cd2d45a24dbf1b9c 2017-12-06 22:39:52,502 INFO [Time-limited test] assignment.RegionStateStore(133): Load hbase:meta entry region={ENCODED => 96421c5076ee875a127eb57188aec78d, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,c,1512599988575.96421c5076ee875a127eb57188aec78d.', STARTKEY => 'c', ENDKEY => ''} regionState=null lastHost=null regionLocation=null 2017-12-06 22:39:52,502 INFO [Time-limited test] assignment.AssignmentManager$1(1191): 96421c5076ee875a127eb57188aec78d state=null; presuming OFFLINE 2017-12-06 22:39:52,502 INFO [Time-limited test] assignment.RegionStates(852): Added to offline, CURRENTLY NEVER CLEARED!!! rit=OFFLINE, location=null, table=testRecoveryAndDoubleExecutionPreserveSplits, region=96421c5076ee875a127eb57188aec78d 2017-12-06 22:39:52,503 INFO [Time-limited test] assignment.AssignmentManager(1165): RS joined 1 2017-12-06 22:39:52,508 INFO [Time-limited test] assignment.AssignmentManager(1243): [STEP-1] 5msec 2017-12-06 22:39:52,509 INFO [Time-limited test] assignment.AssignmentManager(1255): [STEP-2] 0msec 2017-12-06 22:39:52,557 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=84, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:39:52,559 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=84, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,,1512599988575.6190bf675a14a1eedcf58368d0992978. 2017-12-06 22:39:52,561 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=84, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:52,623 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=85, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e 2017-12-06 22:39:52,691 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=85, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e testRecoveryAndDoubleExecutionPreserveSplits testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:52,694 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=85, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:39:52,765 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=86, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=a250ba3efe61b8e8cd2d45a24dbf1b9c 2017-12-06 22:39:52,814 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=85 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,815 INFO [ProcExecWrkr-1] zookeeper.ReadOnlyZKClient(130): Start read only zookeeper connection 0x2ddabd09 to localhost:49877, session timeout 90000 ms, retries 30, retry interval 1000 ms, keep alive 60000 ms 2017-12-06 22:39:52,834 DEBUG [ProcExecWrkr-1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4db2d5c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2017-12-06 22:39:52,836 DEBUG [MultiHConnection-shared--pool22-t1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:39:52,845 DEBUG [RS-EventLoopGroup-3-15] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:47178; # active connections: 3 2017-12-06 22:39:52,846 INFO [RS-EventLoopGroup-3-15] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:39:52,847 INFO [RS-EventLoopGroup-3-15] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 47178 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:39:52,850 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=85, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:52,873 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=87, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=96421c5076ee875a127eb57188aec78d 2017-12-06 22:39:52,873 INFO [Time-limited test] assignment.AssignmentManager(1266): [STEP-3] 364msec 2017-12-06 22:39:52,874 INFO [Time-limited test] procedure2.ProcedureExecutor$TimeoutExecutorThread(1823): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1512599997874 2017-12-06 22:39:52,874 INFO [Time-limited test] assignment.AssignmentManager(1174): Joined the cluster in 384msec, failover=false 2017-12-06 22:39:53,001 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:39:53,003 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:53,007 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => 84d67cd4b84b3eb223bc0ffdc96e8e5e, NAME => 'testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:39:53,008 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testRecoveryAndDoubleExecutionPreserveSplits 84d67cd4b84b3eb223bc0ffdc96e8e5e 2017-12-06 22:39:53,008 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:53,016 DEBUG [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/f1 2017-12-06 22:39:53,016 DEBUG [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/f1 2017-12-06 22:39:53,016 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:53,016 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:53,017 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:53,017 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:53,020 DEBUG [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/f2 2017-12-06 22:39:53,021 DEBUG [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/f2 2017-12-06 22:39:53,021 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:39:53,021 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:39:53,021 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:39:53,021 INFO [StoreOpener-84d67cd4b84b3eb223bc0ffdc96e8e5e-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:39:53,023 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:53,024 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e 2017-12-06 22:39:53,026 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testRecoveryAndDoubleExecutionPreserveSplits, use config (67108864) instead 2017-12-06 22:39:53,030 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:39:53,030 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined 84d67cd4b84b3eb223bc0ffdc96e8e5e; next sequenceid=2 2017-12-06 22:39:53,032 INFO [PostOpenDeployTasks:84d67cd4b84b3eb223bc0ffdc96e8e5e] regionserver.HRegionServer(2204): Post open deploy tasks for testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:53,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=85, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:53,034 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=85 updating hbase:meta row=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:53,034 DEBUG [PostOpenDeployTasks:84d67cd4b84b3eb223bc0ffdc96e8e5e] regionserver.HRegionServer(2228): Finished post open deploy task for testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:39:53,035 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:39:53,040 WARN [ProcExecWrkr-1] procedure2.ProcedureExecutor$Testing(97): Toggle KILL before store update to: true 2017-12-06 22:39:53,113 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=85, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e in 483msec 2017-12-06 22:39:53,902 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076, blk_1073741901_1077] 2017-12-06 22:39:55,274 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:39:55,693 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:39:58,511 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:40:22,035 DEBUG [ProcExecTimeout] procedure2.ProcedureExecutor$CompletedProcedureCleaner(220): Evict completed pid=85, state=SUCCESS; AssignProcedure table=testRecoveryAndDoubleExecutionPreserveSplits, region=84d67cd4b84b3eb223bc0ffdc96e8e5e 2017-12-06 22:40:35,880 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:40:35,890 INFO [Time-limited test] procedure.TestTableDDLProcedureBase(67): Tear down, remove table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:35,892 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:35,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:35,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:35,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:36,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:36,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:36,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:37,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:38,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:40,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:44,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:46,201 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:40:48,842 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:40:50,507 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1069 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:40:50,512 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:40:50,513 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:40:50,513 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:40:50,513 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1170 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:40:50,513 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:40:50,515 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:40:50,515 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:40:50,515 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1171 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:40:50,515 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:40:50,515 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:40:50,518 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:40:50,524 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:40:50,523 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:40:50,525 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:40:50,525 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:40:50,525 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:50,526 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:40:50,526 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:40:50,526 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:40:50,526 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:40:50,526 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:40:50,528 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:40:50,528 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:40:50,528 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:40:50,528 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:40:50,529 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:40:50,530 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:40:50,530 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:40:50,530 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:40:50,530 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:40:50,530 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:40:50,531 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:40:50,531 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:40:50,531 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:40:50,532 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:40:50,531 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:40:50,533 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:40:50,534 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:40:50,534 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,535 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:40:50,535 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 with reasons: undeletable, please check. 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable with reasons: undeletable, please check. 2017-12-06 22:40:50,537 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:40:50,537 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:40:50,537 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:40:50,536 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:40:50,537 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:40:50,537 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:40:50,538 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:40:50,539 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:40:50,539 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:40:50,539 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:40:50,539 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:40:50,539 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:40:50,540 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:40:50,540 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:40:50,541 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:40:50,541 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:40:50,541 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:40:50,542 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:40:50,541 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:40:50,542 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:40:50,541 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:40:50,542 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:40:50,543 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,543 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:40:50,544 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:40:50,544 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:40:50,543 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:40:50,544 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:40:50,544 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:40:50,544 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:40:50,545 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:40:50,545 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:40:50,545 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,545 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:40:50,545 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:40:50,546 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:40:50,546 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:40:50,546 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:40:50,546 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:40:50,546 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:40:50,547 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:40:50,549 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:40:50,550 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,551 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:40:50,551 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:40:50,551 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:40:50,551 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:40:50,551 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:40:50,553 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,554 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:40:50,554 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:40:50,554 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:40:50,556 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:40:50,555 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:40:50,555 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,557 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:40:50,557 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:40:50,557 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:40:50,559 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,559 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:40:50,560 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:40:50,559 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:40:50,560 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:40:50,560 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:40:50,560 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:40:50,560 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:40:50,561 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,561 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:40:50,561 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:40:50,561 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:40:50,562 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:40:50,562 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,562 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:40:50,563 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:40:50,562 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:40:50,563 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:40:50,563 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:40:50,563 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 with reasons: undeletable, please check. 2017-12-06 22:40:50,563 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:40:50,564 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,564 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:40:50,564 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:40:50,564 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:40:50,565 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:40:50,565 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,565 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:40:50,565 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:40:50,565 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 with reasons: undeletable, please check. 2017-12-06 22:40:50,566 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:40:50,566 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:40:50,566 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:40:50,567 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:40:50,567 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:40:50,567 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:40:50,567 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:40:50,568 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,568 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:40:50,568 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:40:50,568 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:40:50,568 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:40:50,569 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:40:50,569 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 with reasons: undeletable, please check. 2017-12-06 22:40:50,569 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:40:50,570 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:40:50,570 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:40:50,570 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:40:50,570 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:40:50,570 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:40:50,571 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff with reasons: undeletable, please check. 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:40:50,572 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1177 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:40:50,573 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:40:50,575 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:40:50,576 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:40:50,576 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:40:50,576 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c with reasons: undeletable, please check. 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:40:50,577 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:40:50,579 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:40:50,581 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1177 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:40:50,580 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:40:50,581 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:40:50,581 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:40:50,583 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:40:50,584 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:40:50,585 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:40:50,585 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:40:50,585 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,586 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:40:50,586 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:40:50,586 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:40:50,586 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:40:50,586 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:40:50,587 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,587 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:40:50,587 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:40:50,587 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:40:50,588 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:40:50,591 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,591 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:40:50,591 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:40:50,591 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:40:50,594 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:40:50,596 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f with reasons: undeletable, please check. 2017-12-06 22:40:50,597 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1178 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:40:50,598 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:40:50,598 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,599 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:40:50,599 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:40:50,599 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1177 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:40:50,600 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:40:50,600 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:40:50,600 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:40:50,600 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,600 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1178 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 with reasons: undeletable, please check. 2017-12-06 22:40:50,601 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:40:50,602 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:40:50,602 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:40:50,603 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,603 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:40:50,603 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:40:50,603 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:40:50,604 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:40:50,604 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 with reasons: undeletable, please check. 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:40:50,605 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:40:50,606 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:40:50,606 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:40:50,606 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,606 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:40:50,606 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:40:50,607 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:40:50,607 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:40:50,607 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:40:50,607 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1178 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:40:50,607 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:40:50,610 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:40:50,610 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:40:50,611 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,611 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:40:50,611 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:40:50,613 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:40:50,613 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:40:50,613 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:40:50,613 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:40:50,613 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:40:50,614 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1176 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:40:50,614 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,614 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:40:50,614 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:40:50,615 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:40:50,616 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:40:50,616 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 with reasons: undeletable, please check. 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:40:50,617 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1177 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:40:50,618 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 with reasons: undeletable, please check. 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1172 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:40:50,619 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:40:50,620 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,620 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:40:50,620 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:40:50,620 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:40:50,621 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:40:50,621 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:40:50,622 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:40:50,622 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:40:50,622 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1177 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:40:50,623 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:40:50,624 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:40:50,624 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,625 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:40:50,625 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:40:50,625 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:40:50,625 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:40:50,626 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,626 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:40:50,626 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:40:50,626 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1175 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 with reasons: undeletable, please check. 2017-12-06 22:40:50,628 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1174 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:40:50,627 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:40:50,628 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,628 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 with reasons: undeletable, please check. 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,629 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:40:50,630 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:40:50,630 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 with reasons: undeletable, please check. 2017-12-06 22:40:50,630 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:40:50,631 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:40:50,631 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:40:50,631 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:40:50,632 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 with reasons: undeletable, please check. 2017-12-06 22:40:50,632 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:40:50,633 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:40:50,634 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 with reasons: undeletable, please check. 2017-12-06 22:40:50,634 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:40:50,634 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:40:50,634 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 with reasons: undeletable, please check. 2017-12-06 22:40:50,635 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:40:50,635 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:40:50,635 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:40:50,635 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:40:50,635 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:40:50,638 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1069 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:40:50,639 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:40:50,684 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:40:52,835 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x2ddabd09 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:40:52,876 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:40:54,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:40:55,701 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:40:57,877 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:02,877 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:04,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:41:07,877 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:12,878 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:14,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:41:17,879 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:22,880 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:24,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:41:27,881 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:32,881 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:37,883 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:38,287 DEBUG [RS-EventLoopGroup-3-9] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46382. Number of active connections: 2 2017-12-06 22:41:42,884 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:44,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:41:46,201 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:41:47,885 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:48,101 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:41:48,107 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:41:48,107 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:41:48,107 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:41:48,107 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1178 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:41:48,107 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:41:48,108 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:41:48,109 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:41:48,109 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:41:48,109 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:41:48,109 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1182 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:41:48,111 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:41:48,116 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1183 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:41:48,116 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:41:48,116 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:41:48,116 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:41:48,116 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:41:48,117 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:41:48,117 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:41:48,117 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:41:48,118 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:41:48,118 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:41:48,121 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:41:48,121 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:41:48,121 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:41:48,121 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:41:48,121 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:41:48,122 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:41:48,122 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:41:48,125 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:41:48,125 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:41:48,127 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:41:48,126 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:41:48,127 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:41:48,127 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:41:48,127 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:41:48,128 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:41:48,128 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:41:48,129 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:41:48,129 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:41:48,129 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:41:48,129 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:41:48,129 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:41:48,130 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:41:48,132 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:41:48,132 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:41:48,132 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:41:48,131 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:41:48,132 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:41:48,133 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:41:48,133 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:41:48,133 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:41:48,134 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:41:48,134 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:41:48,134 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:41:48,135 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,135 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:41:48,135 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:41:48,135 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:41:48,136 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,136 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 with reasons: undeletable, please check. 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable with reasons: undeletable, please check. 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:41:48,137 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:41:48,138 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,138 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:41:48,138 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:41:48,138 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:41:48,139 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:41:48,139 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:41:48,140 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:41:48,141 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:41:48,141 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:41:48,141 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:41:48,141 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:41:48,141 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:41:48,142 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:41:48,143 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:41:48,143 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:41:48,143 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,143 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:41:48,144 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:41:48,143 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:41:48,144 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:41:48,144 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:41:48,146 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:41:48,146 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:41:48,146 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,147 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:41:48,147 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:41:48,147 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:41:48,148 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:41:48,148 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:41:48,148 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,149 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:41:48,149 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:41:48,149 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 with reasons: undeletable, please check. 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:41:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:41:48,151 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:41:48,151 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1189 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:41:48,152 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,152 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:41:48,152 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:41:48,152 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:41:48,152 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:41:48,153 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:41:48,153 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,153 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:41:48,154 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff with reasons: undeletable, please check. 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:41:48,155 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1190 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:41:48,156 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:41:48,157 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:41:48,157 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:41:48,158 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f with reasons: undeletable, please check. 2017-12-06 22:41:48,157 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1189 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:41:48,158 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:41:48,157 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:41:48,158 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:41:48,158 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,159 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:41:48,159 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:41:48,159 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:41:48,159 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:41:48,159 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:41:48,160 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:41:48,161 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:41:48,162 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1190 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:41:48,163 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:41:48,164 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 with reasons: undeletable, please check. 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:41:48,165 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 with reasons: undeletable, please check. 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:41:48,166 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,168 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:41:48,168 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:41:48,167 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:41:48,168 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1192 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:41:48,168 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:41:48,168 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:41:48,169 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:41:48,169 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:41:48,169 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:41:48,169 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:41:48,169 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:41:48,170 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:41:48,171 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:41:48,171 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,171 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:41:48,171 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:41:48,171 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1190 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:41:48,172 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:41:48,172 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:41:48,173 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:41:48,174 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,174 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:41:48,174 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:41:48,174 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:41:48,175 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:41:48,175 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:41:48,176 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:41:48,177 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,177 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:41:48,177 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:41:48,177 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1192 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:41:48,178 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:41:48,178 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:41:48,178 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:41:48,178 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,178 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:41:48,179 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:41:48,179 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:41:48,179 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c with reasons: undeletable, please check. 2017-12-06 22:41:48,179 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1189 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1186 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:41:48,180 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:41:48,181 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,182 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:41:48,182 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:41:48,181 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:41:48,183 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,183 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:41:48,183 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:41:48,183 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1189 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:41:48,184 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1192 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 with reasons: undeletable, please check. 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:41:48,185 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:41:48,186 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1193 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:41:48,186 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:41:48,188 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:41:48,187 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:41:48,188 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:41:48,188 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1189 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:41:48,188 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:41:48,188 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1185 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 with reasons: undeletable, please check. 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1188 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:41:48,189 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,190 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 with reasons: undeletable, please check. 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1187 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:41:48,191 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:41:48,192 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:41:48,192 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,192 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:41:48,192 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:41:48,192 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:41:48,193 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 with reasons: undeletable, please check. 2017-12-06 22:41:48,193 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1190 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:41:48,193 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:41:48,193 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1184 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:41:48,194 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:41:48,195 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:41:48,195 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:41:48,195 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:41:48,196 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,196 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:41:48,196 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:41:48,197 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,197 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:41:48,197 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:41:48,199 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,199 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:41:48,199 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:41:48,199 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 with reasons: undeletable, please check. 2017-12-06 22:41:48,201 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,201 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:41:48,201 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:41:48,203 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,203 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:41:48,203 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:41:48,204 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 with reasons: undeletable, please check. 2017-12-06 22:41:48,204 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:41:48,205 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:41:48,205 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 with reasons: undeletable, please check. 2017-12-06 22:41:48,205 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:41:48,206 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:41:48,206 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:41:48,206 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:41:48,208 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,208 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:41:48,208 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:41:48,208 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 with reasons: undeletable, please check. 2017-12-06 22:41:48,210 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 with reasons: undeletable, please check. 2017-12-06 22:41:48,210 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:41:48,210 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:41:48,210 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 with reasons: undeletable, please check. 2017-12-06 22:41:48,212 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:41:48,212 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:41:48,212 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:41:48,212 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:41:48,213 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:41:48,217 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1173 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:41:48,219 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:41:48,843 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:41:50,685 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:41:52,859 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x2ddabd09 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:41:52,886 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:41:53,039 DEBUG [RS-EventLoopGroup-3-15] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:47178. Number of active connections: 1 2017-12-06 22:41:53,060 DEBUG [RS-EventLoopGroup-3-4] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46308. Number of active connections: 0 2017-12-06 22:41:55,701 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:41:57,886 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:02,887 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:04,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:42:07,888 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:12,889 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:17,889 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:22,890 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:24,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=88 2017-12-06 22:42:27,891 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:32,892 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:35,910 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testRecoveryAndDoubleExecutionPreserveSplits Thread=210 (was 245), OpenFileDescriptor=747 (was 795), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 597), ProcessCount=249 (was 250), AvailableMemoryMB=12461 (was 12280) - AvailableMemoryMB LEAK? - 2017-12-06 22:42:35,932 INFO [main] hbase.ResourceChecker(148): before: master.procedure.TestTruncateTableProcedure#testSimpleTruncatePreserveSplits Thread=210, OpenFileDescriptor=747, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=249, AvailableMemoryMB=12461 2017-12-06 22:42:35,932 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:42:35,987 DEBUG [RS-EventLoopGroup-3-6] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46320. Number of active connections: -1 2017-12-06 22:42:36,004 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=89, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSimpleTruncatePreserveSplits 2017-12-06 22:42:36,006 DEBUG [ProcExecWrkr-1] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:42:36,011 DEBUG [RS-EventLoopGroup-3-17] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:48294; # active connections: 0 2017-12-06 22:42:36,012 INFO [RS-EventLoopGroup-3-17] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:42:36,013 INFO [RS-EventLoopGroup-3-17] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 48294 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:42:36,083 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741909_1085{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 987 2017-12-06 22:42:36,489 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:42:36,492 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:36,492 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:36,493 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:36,493 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:36,510 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741911_1087{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 69 2017-12-06 22:42:36,510 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741912_1088{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:42:36,512 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741913_1089{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 68 2017-12-06 22:42:36,512 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741910_1086{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 69 2017-12-06 22:42:36,512 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:36,512 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.: disabling compactions & flushes 2017-12-06 22:42:36,512 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:36,513 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:36,911 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:36,911 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.: disabling compactions & flushes 2017-12-06 22:42:36,912 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:36,912 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:36,915 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:36,915 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.: disabling compactions & flushes 2017-12-06 22:42:36,915 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:36,915 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:36,915 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:36,915 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.: disabling compactions & flushes 2017-12-06 22:42:36,916 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:36,916 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:36,989 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:42:36,995 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:42:37,044 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600157044}]},"ts":1512600157044} 2017-12-06 22:42:37,047 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to ENABLING in META 2017-12-06 22:42:37,048 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=90, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd}, {pid=91, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d}, {pid=92, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022}, {pid=93, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98}] 2017-12-06 22:42:37,120 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=93, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,123 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=93, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:37,167 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=92, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,168 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=92, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:37,208 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=91, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,210 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=91, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:37,250 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=90, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,251 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=90, ppid=89, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:37,292 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=90 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,297 DEBUG [MultiHConnection-shared--pool22-t3] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:42:37,302 DEBUG [RS-EventLoopGroup-3-19] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:48312; # active connections: 1 2017-12-06 22:42:37,303 INFO [RS-EventLoopGroup-3-19] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:42:37,303 INFO [RS-EventLoopGroup-3-19] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 48312 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:42:37,306 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=90, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,350 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=91 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,353 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=91, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,395 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=92 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,398 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=92, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,436 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=93 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,439 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=93, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,457 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:42:37,457 DEBUG [RSProcedureDispatcher-pool4-t26] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:42:37,462 DEBUG [RS-EventLoopGroup-3-21] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:48314; # active connections: 2 2017-12-06 22:42:37,463 INFO [RS-EventLoopGroup-3-21] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:42:37,463 INFO [RS-EventLoopGroup-3-21] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 48314 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:42:37,464 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,471 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,471 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,471 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => 01ca9697a8eeddceb04c8ea2b5d19022, NAME => 'testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:42:37,471 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,471 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => 2609f83cdaf1e5fdf1bb5aa708582d98, NAME => 'testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.', STARTKEY => '', ENDKEY => 'a'} 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits 01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => ef00b25551d15362669b1b0a2873967d, NAME => 'testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.', STARTKEY => 'b', ENDKEY => 'c'} 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits 2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,472 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,478 DEBUG [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:37,479 DEBUG [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:37,479 DEBUG [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:37,479 DEBUG [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:37,479 DEBUG [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:37,479 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,479 DEBUG [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:37,479 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,480 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,480 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,480 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,480 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,480 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,480 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,480 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,481 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,481 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,482 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,485 DEBUG [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:37,485 DEBUG [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:37,485 DEBUG [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:37,485 DEBUG [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:37,485 DEBUG [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:37,485 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,486 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,485 DEBUG [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:37,486 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,486 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,486 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,486 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,486 INFO [StoreOpener-ef00b25551d15362669b1b0a2873967d-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,486 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,486 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,487 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,487 INFO [StoreOpener-01ca9697a8eeddceb04c8ea2b5d19022-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,487 INFO [StoreOpener-2609f83cdaf1e5fdf1bb5aa708582d98-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,488 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,488 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,489 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:37,489 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,489 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:37,490 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:37,491 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:37,491 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:37,492 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:37,495 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:37,495 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:37,495 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:37,495 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined 01ca9697a8eeddceb04c8ea2b5d19022; next sequenceid=2 2017-12-06 22:42:37,497 INFO [PostOpenDeployTasks:01ca9697a8eeddceb04c8ea2b5d19022] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,495 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined 2609f83cdaf1e5fdf1bb5aa708582d98; next sequenceid=2 2017-12-06 22:42:37,495 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined ef00b25551d15362669b1b0a2873967d; next sequenceid=2 2017-12-06 22:42:37,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=92, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,503 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=92 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,503 DEBUG [PostOpenDeployTasks:01ca9697a8eeddceb04c8ea2b5d19022] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:37,503 INFO [PostOpenDeployTasks:ef00b25551d15362669b1b0a2873967d] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,504 INFO [PostOpenDeployTasks:2609f83cdaf1e5fdf1bb5aa708582d98] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,504 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=91, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,506 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => 3bdc4b6a5d824e1b9f5f67fc1e5b33dd, NAME => 'testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.', STARTKEY => 'c', ENDKEY => ''} 2017-12-06 22:42:37,506 DEBUG [PostOpenDeployTasks:ef00b25551d15362669b1b0a2873967d] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:37,507 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,507 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits 3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:37,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=93, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,508 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,508 DEBUG [PostOpenDeployTasks:2609f83cdaf1e5fdf1bb5aa708582d98] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:37,509 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,513 DEBUG [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:37,514 DEBUG [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:37,514 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,514 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,514 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,515 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,518 DEBUG [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:37,518 DEBUG [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:37,518 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:37,518 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:37,518 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:37,519 INFO [StoreOpener-3bdc4b6a5d824e1b9f5f67fc1e5b33dd-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:37,520 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,520 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:37,522 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:37,531 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:37,531 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined 3bdc4b6a5d824e1b9f5f67fc1e5b33dd; next sequenceid=2 2017-12-06 22:42:37,533 INFO [PostOpenDeployTasks:3bdc4b6a5d824e1b9f5f67fc1e5b33dd] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=90, ppid=89, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,535 DEBUG [PostOpenDeployTasks:3bdc4b6a5d824e1b9f5f67fc1e5b33dd] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:37,535 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,544 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=92, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:37,545 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=92, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022 in 463msec 2017-12-06 22:42:37,545 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=90 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,578 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=90, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:37,578 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=90, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd in 501msec 2017-12-06 22:42:37,578 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=93 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,611 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=93, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:37,611 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=93, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98 in 534msec 2017-12-06 22:42:37,612 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=91 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:37,650 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=91, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:37,697 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=89, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=testSimpleTruncatePreserveSplits; resume parent processing. 2017-12-06 22:42:37,697 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=91, ppid=89, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d in 567msec 2017-12-06 22:42:37,698 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600157698}]},"ts":1512600157698} 2017-12-06 22:42:37,701 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to ENABLED in META 2017-12-06 22:42:37,767 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=89, state=SUCCESS; CreateTableProcedure table=testSimpleTruncatePreserveSplits in 1.8000sec 2017-12-06 22:42:37,893 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:38,008 DEBUG [hconnection-0x4c447c09-metaLookup-shared--pool15-t15] ipc.NettyRpcConnection(255): Connecting to asf911.gq1.ygridcore.net/67.195.81.155:43202 2017-12-06 22:42:38,013 DEBUG [RS-EventLoopGroup-3-22] ipc.NettyRpcServerRequestDecoder(53): Connection from /67.195.81.155:48320; # active connections: 3 2017-12-06 22:42:38,015 INFO [RS-EventLoopGroup-3-22] ipc.ServerRpcConnection(527): Auth successful for jenkins (auth:SIMPLE) 2017-12-06 22:42:38,016 INFO [RS-EventLoopGroup-3-22] ipc.ServerRpcConnection(557): Connection from 67.195.81.155 port: 48320 with version info: version: "3.0.0-SNAPSHOT" url: "git://asf911.gq1.ygridcore.net/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests" revision: "3e7b90ac6d808c171ea988d8d32ef998146713ac" user: "jenkins" date: "Wed Dec 6 22:20:25 UTC 2017" src_checksum: "f937fbee720d4559f0d1fda68e2c1192" version_major: 3 version_minor: 0 2017-12-06 22:42:38,036 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:38,038 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:38,040 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:38,040 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:38,048 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:42:38,051 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:42:38,053 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:42:38,056 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testSimpleTruncatePreserveSplits 2017-12-06 22:42:38,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testSimpleTruncatePreserveSplits 2017-12-06 22:42:38,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=94, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSimpleTruncatePreserveSplits 2017-12-06 22:42:38,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:38,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:38,213 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600158213}]},"ts":1512600158213} 2017-12-06 22:42:38,217 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to DISABLING in META 2017-12-06 22:42:38,260 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=95, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=96, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=97, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033}, {pid=98, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033}] 2017-12-06 22:42:38,309 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=98, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:38,310 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=98 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,313 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=98, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,360 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=97, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:38,360 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=97 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,363 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=97, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:38,409 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=96, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:38,410 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=96 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,413 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=96, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,460 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=95, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:38,460 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=95 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98., regionState=CLOSING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,463 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=95, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:38,464 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:42:38,465 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 3bdc4b6a5d824e1b9f5f67fc1e5b33dd without moving 2017-12-06 22:42:38,465 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close ef00b25551d15362669b1b0a2873967d without moving 2017-12-06 22:42:38,465 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:38,465 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 2609f83cdaf1e5fdf1bb5aa708582d98 without moving 2017-12-06 22:42:38,467 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.: disabling compactions & flushes 2017-12-06 22:42:38,467 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1517): Close 01ca9697a8eeddceb04c8ea2b5d19022 without moving 2017-12-06 22:42:38,467 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:38,467 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:38,467 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=3.40 KB 2017-12-06 22:42:38,467 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:38,468 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.: disabling compactions & flushes 2017-12-06 22:42:38,469 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:38,468 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.store: f1 2017-12-06 22:42:38,469 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.: disabling compactions & flushes 2017-12-06 22:42:38,470 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:38,470 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,469 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=800 B 2017-12-06 22:42:38,470 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.store: f2 2017-12-06 22:42:38,470 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=7.72 KB 2017-12-06 22:42:38,470 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,470 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.store: f1 2017-12-06 22:42:38,471 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.store: f1 2017-12-06 22:42:38,471 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,471 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,471 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.store: f2 2017-12-06 22:42:38,471 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.store: f2 2017-12-06 22:42:38,472 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,472 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:38,496 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741914_1090{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5328 2017-12-06 22:42:38,497 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741916_1092{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 9054 2017-12-06 22:42:38,497 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741915_1091{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 6714 2017-12-06 22:42:38,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:38,897 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/.tmp/f1/8467563c553b44bc81137490affc453b 2017-12-06 22:42:38,897 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/.tmp/f1/4294992a6983495c9566f325c78d0607 2017-12-06 22:42:38,897 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=3.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/.tmp/f1/05a1d553c99d43fa81b6e5360be239b4 2017-12-06 22:42:38,918 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741917_1093{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5328 2017-12-06 22:42:38,919 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741919_1095{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 9054 2017-12-06 22:42:38,919 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741918_1094{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 6714 2017-12-06 22:42:39,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:39,320 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/.tmp/f2/51aac9f101534a718b6f798a1104d13e 2017-12-06 22:42:39,320 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=3.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/.tmp/f2/677f1569ee1f4564bda58f65d4fd0f76 2017-12-06 22:42:39,320 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/.tmp/f2/c7c89730a39a4112a4839338c23f27fc 2017-12-06 22:42:39,330 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/.tmp/f1/05a1d553c99d43fa81b6e5360be239b4 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1/05a1d553c99d43fa81b6e5360be239b4 2017-12-06 22:42:39,330 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/.tmp/f1/4294992a6983495c9566f325c78d0607 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1/4294992a6983495c9566f325c78d0607 2017-12-06 22:42:39,330 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/.tmp/f1/8467563c553b44bc81137490affc453b as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1/8467563c553b44bc81137490affc453b 2017-12-06 22:42:39,338 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1/4294992a6983495c9566f325c78d0607, entries=26, sequenceid=5, filesize=6.6 K 2017-12-06 22:42:39,338 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1/8467563c553b44bc81137490affc453b, entries=6, sequenceid=5, filesize=5.2 K 2017-12-06 22:42:39,338 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1/05a1d553c99d43fa81b6e5360be239b4, entries=59, sequenceid=5, filesize=8.8 K 2017-12-06 22:42:39,340 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/.tmp/f2/51aac9f101534a718b6f798a1104d13e as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2/51aac9f101534a718b6f798a1104d13e 2017-12-06 22:42:39,340 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/.tmp/f2/c7c89730a39a4112a4839338c23f27fc as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2/c7c89730a39a4112a4839338c23f27fc 2017-12-06 22:42:39,340 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/.tmp/f2/677f1569ee1f4564bda58f65d4fd0f76 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2/677f1569ee1f4564bda58f65d4fd0f76 2017-12-06 22:42:39,348 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2/c7c89730a39a4112a4839338c23f27fc, entries=26, sequenceid=5, filesize=6.6 K 2017-12-06 22:42:39,348 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2/51aac9f101534a718b6f798a1104d13e, entries=6, sequenceid=5, filesize=5.2 K 2017-12-06 22:42:39,350 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2/677f1569ee1f4564bda58f65d4fd0f76, entries=59, sequenceid=5, filesize=8.8 K 2017-12-06 22:42:39,352 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~3.40 KB/3480, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. in 885ms, sequenceid=5, compaction requested=false 2017-12-06 22:42:39,353 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~7.72 KB/7906, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. in 883ms, sequenceid=5, compaction requested=false 2017-12-06 22:42:39,354 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~800 B/800, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. in 885ms, sequenceid=5, compaction requested=false 2017-12-06 22:42:39,356 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:42:39,358 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:42:39,359 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:42:39,358 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:42:39,362 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:42:39,362 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:42:39,368 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:42:39,368 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:42:39,368 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:42:39,369 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:39,369 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:39,369 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=95, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=97, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=98, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,370 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=95 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98., regionState=CLOSED 2017-12-06 22:42:39,370 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. 2017-12-06 22:42:39,370 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. 2017-12-06 22:42:39,371 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:39,370 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. 2017-12-06 22:42:39,372 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.: disabling compactions & flushes 2017-12-06 22:42:39,372 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:39,372 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=1.17 KB 2017-12-06 22:42:39,373 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.store: f1 2017-12-06 22:42:39,373 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:39,373 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.store: f2 2017-12-06 22:42:39,373 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:42:39,385 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741920_1096{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5540 2017-12-06 22:42:39,419 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=95, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,420 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=95, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=2609f83cdaf1e5fdf1bb5aa708582d98, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1150sec 2017-12-06 22:42:39,420 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=98 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd., regionState=CLOSED 2017-12-06 22:42:39,461 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=98, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,461 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=98, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=3bdc4b6a5d824e1b9f5f67fc1e5b33dd, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.1630sec 2017-12-06 22:42:39,462 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=97 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d., regionState=CLOSED 2017-12-06 22:42:39,503 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=97, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:39,503 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=97, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=ef00b25551d15362669b1b0a2873967d, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.2040sec 2017-12-06 22:42:39,787 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=601, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/.tmp/f1/4508041df76b40ac93c79a44f6feeca0 2017-12-06 22:42:39,807 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741921_1097{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5540 2017-12-06 22:42:40,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:40,208 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=601, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/.tmp/f2/7bb6c35865f543ffa8589acb2c704892 2017-12-06 22:42:40,219 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/.tmp/f1/4508041df76b40ac93c79a44f6feeca0 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1/4508041df76b40ac93c79a44f6feeca0 2017-12-06 22:42:40,227 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1/4508041df76b40ac93c79a44f6feeca0, entries=9, sequenceid=5, filesize=5.4 K 2017-12-06 22:42:40,229 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/.tmp/f2/7bb6c35865f543ffa8589acb2c704892 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2/7bb6c35865f543ffa8589acb2c704892 2017-12-06 22:42:40,236 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2/7bb6c35865f543ffa8589acb2c704892, entries=9, sequenceid=5, filesize=5.4 K 2017-12-06 22:42:40,238 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~1.17 KB/1202, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. in 866ms, sequenceid=5, compaction requested=false 2017-12-06 22:42:40,239 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:42:40,240 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:42:40,246 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:42:40,248 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report CLOSED seqId=-1, pid=96, ppid=94, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033; rit=CLOSING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:40,249 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=96 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022., regionState=CLOSED 2017-12-06 22:42:40,249 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. 2017-12-06 22:42:40,295 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=96, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:40,365 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=94, state=RUNNABLE:DISABLE_TABLE_SET_DISABLED_TABLE_STATE; DisableTableProcedure table=testSimpleTruncatePreserveSplits; resume parent processing. 2017-12-06 22:42:40,365 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=96, ppid=94, state=SUCCESS; UnassignProcedure table=testSimpleTruncatePreserveSplits, region=01ca9697a8eeddceb04c8ea2b5d19022, server=asf911.gq1.ygridcore.net,43202,1512599926033 in 1.9930sec 2017-12-06 22:42:40,365 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600160365}]},"ts":1512600160365} 2017-12-06 22:42:40,369 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to DISABLED in META 2017-12-06 22:42:40,369 INFO [ProcExecWrkr-1] procedure.DisableTableProcedure(285): Disabled table, testSimpleTruncatePreserveSplits, is completed. 2017-12-06 22:42:40,455 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=94, state=SUCCESS; DisableTableProcedure table=testSimpleTruncatePreserveSplits in 2.3570sec 2017-12-06 22:42:42,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=94 2017-12-06 22:42:42,210 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3634): Operation: DISABLE, Table Name: default:testSimpleTruncatePreserveSplits completed 2017-12-06 22:42:42,255 DEBUG [Time-limited test] procedure2.ProcedureExecutor(868): Stored pid=99, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=testSimpleTruncatePreserveSplits preserveSplits=true) 2017-12-06 22:42:42,261 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(88): waiting for 'testSimpleTruncatePreserveSplits' regions in transition 2017-12-06 22:42:42,306 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162305}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162305}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162305}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162305}]},"ts":9223372036854775807} 2017-12-06 22:42:42,310 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:42:42,310 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 2609f83cdaf1e5fdf1bb5aa708582d98, NAME => 'testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => 01ca9697a8eeddceb04c8ea2b5d19022, NAME => 'testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => ef00b25551d15362669b1b0a2873967d, NAME => 'testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 3bdc4b6a5d824e1b9f5f67fc1e5b33dd, NAME => 'testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:42:42,313 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(389): Removing 'testSimpleTruncatePreserveSplits' from region states. 2017-12-06 22:42:42,314 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162313}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162313}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162313}]},"ts":9223372036854775807}, Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":1512600162313}]},"ts":9223372036854775807} 2017-12-06 22:42:42,321 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1983): Deleted 4 regions from META 2017-12-06 22:42:42,322 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1985): Deleted regions: [{ENCODED => 2609f83cdaf1e5fdf1bb5aa708582d98, NAME => 'testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98.', STARTKEY => '', ENDKEY => 'a'}, {ENCODED => 01ca9697a8eeddceb04c8ea2b5d19022, NAME => 'testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022.', STARTKEY => 'a', ENDKEY => 'b'}, {ENCODED => ef00b25551d15362669b1b0a2873967d, NAME => 'testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d.', STARTKEY => 'b', ENDKEY => 'c'}, {ENCODED => 3bdc4b6a5d824e1b9f5f67fc1e5b33dd, NAME => 'testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd.', STARTKEY => 'c', ENDKEY => ''}] 2017-12-06 22:42:42,322 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(393): Marking 'testSimpleTruncatePreserveSplits' as deleted. 2017-12-06 22:42:42,323 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1449): Delete{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":1512600162322}]},"ts":9223372036854775807} 2017-12-06 22:42:42,325 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1796): Deleted table testSimpleTruncatePreserveSplits state from META 2017-12-06 22:42:42,385 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. from FS 2017-12-06 22:42:42,385 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:42,390 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits] 2017-12-06 22:42:42,398 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1/05a1d553c99d43fa81b6e5360be239b4, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1/05a1d553c99d43fa81b6e5360be239b4 2017-12-06 22:42:42,404 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2/677f1569ee1f4564bda58f65d4fd0f76, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2/677f1569ee1f4564bda58f65d4fd0f76 2017-12-06 22:42:42,410 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits/8.seqid 2017-12-06 22:42:42,411 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:55766 2017-12-06 22:42:42,411 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:42,411 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. from FS 2017-12-06 22:42:42,411 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:42,415 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits] 2017-12-06 22:42:42,422 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1/4508041df76b40ac93c79a44f6feeca0, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1/4508041df76b40ac93c79a44f6feeca0 2017-12-06 22:42:42,428 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2/7bb6c35865f543ffa8589acb2c704892, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2/7bb6c35865f543ffa8589acb2c704892 2017-12-06 22:42:42,434 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits/8.seqid 2017-12-06 22:42:42,435 INFO [IPC Server handler 2 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741910_1086 127.0.0.1:55766 2017-12-06 22:42:42,435 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:42,435 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. from FS 2017-12-06 22:42:42,435 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:42,439 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits] 2017-12-06 22:42:42,446 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1/8467563c553b44bc81137490affc453b, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1/8467563c553b44bc81137490affc453b 2017-12-06 22:42:42,452 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2/51aac9f101534a718b6f798a1104d13e, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2/51aac9f101534a718b6f798a1104d13e 2017-12-06 22:42:42,457 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits/8.seqid 2017-12-06 22:42:42,458 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741911_1087 127.0.0.1:55766 2017-12-06 22:42:42,458 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:42,459 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(315): Archiving region testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. from FS 2017-12-06 22:42:42,459 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(114): ARCHIVING hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:42,463 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(155): Archiving [class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2, class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits] 2017-12-06 22:42:42,469 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1/4294992a6983495c9566f325c78d0607, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1/4294992a6983495c9566f325c78d0607 2017-12-06 22:42:42,475 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2/c7c89730a39a4112a4839338c23f27fc, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2/c7c89730a39a4112a4839338c23f27fc 2017-12-06 22:42:42,480 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(451): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits/8.seqid, to hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits/8.seqid 2017-12-06 22:42:42,480 INFO [IPC Server handler 8 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741912_1088 127.0.0.1:55766 2017-12-06 22:42:42,481 DEBUG [ProcExecWrkr-1] backup.HFileArchiver(466): Deleted hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:42,481 DEBUG [ProcExecWrkr-1] procedure.DeleteTableProcedure(319): Table 'testSimpleTruncatePreserveSplits' archived! 2017-12-06 22:42:42,482 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741909_1085 127.0.0.1:55766 2017-12-06 22:42:42,561 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741922_1098{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 987 2017-12-06 22:42:42,893 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:42,964 DEBUG [ProcExecWrkr-1] util.FSTableDescriptors(728): Wrote descriptor into: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp/data/default/testSimpleTruncatePreserveSplits/.tabledesc/.tableinfo.0000000001 2017-12-06 22:42:42,967 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:42,968 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:42,968 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:42,968 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(6731): creating HRegion testSimpleTruncatePreserveSplits HTD == 'testSimpleTruncatePreserveSplits', {NAME => 'f1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'f2', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'false', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/.tmp Table name == testSimpleTruncatePreserveSplits 2017-12-06 22:42:42,978 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741923_1099{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:42:42,980 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741925_1101{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 68 2017-12-06 22:42:42,980 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741924_1100{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 69 2017-12-06 22:42:42,980 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:42,981 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.: disabling compactions & flushes 2017-12-06 22:42:42,981 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:42,981 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:42:42,981 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-1] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:42,981 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741926_1102{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 69 2017-12-06 22:42:43,381 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,381 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,381 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.: disabling compactions & flushes 2017-12-06 22:42:43,382 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.: disabling compactions & flushes 2017-12-06 22:42:43,382 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,382 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,382 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-3] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,383 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,382 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-4] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,383 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.: disabling compactions & flushes 2017-12-06 22:42:43,383 DEBUG [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,383 INFO [RegionOpenAndInitThread-testSimpleTruncatePreserveSplits-2] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,437 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1417): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807}, Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.","families":{"info":[{"qualifier":"regioninfo","vlen":68,"tag":[],"timestamp":9223372036854775807}]},"ts":9223372036854775807} 2017-12-06 22:42:43,441 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1614): Added 4 2017-12-06 22:42:43,493 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600163493}]},"ts":1512600163493} 2017-12-06 22:42:43,497 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to ENABLING in META 2017-12-06 22:42:43,497 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1495): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7}, {pid=101, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7}, {pid=102, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb}, {pid=103, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a}] 2017-12-06 22:42:43,561 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=103, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,563 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=103, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:43,611 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=102, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,613 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=102, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:43,662 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=101, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,663 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=101, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:43,712 INFO [ProcExecWrkr-1] procedure.MasterProcedureScheduler(814): pid=100, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7 testSimpleTruncatePreserveSplits testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,713 INFO [ProcExecWrkr-1] assignment.AssignProcedure(208): Start pid=100, ppid=99, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2017-12-06 22:42:43,762 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=102 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,766 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=102, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,812 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=101 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,815 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=101, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,862 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=103 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,865 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=103, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,912 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=100 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7., regionState=OPENING, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,914 INFO [ProcExecWrkr-1] assignment.RegionTransitionProcedure(212): Dispatch pid=100, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,916 INFO [ProcedureDispatcherTimeoutThread] procedure.RSProcedureDispatcher(109): Using procedure batch rpc execution for serverName=asf911.gq1.ygridcore.net,43202,1512599926033 version=3145728 2017-12-06 22:42:43,918 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,923 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,923 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(6908): Opening region: {ENCODED => c24958fa636e29e21028e350d32623fb, NAME => 'testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.', STARTKEY => 'c', ENDKEY => ''} 2017-12-06 22:42:43,923 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,924 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.RSRpcServices(1892): Open testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => 1c6cd8294a789f4998b71741869e1aa7, NAME => 'testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.', STARTKEY => 'b', ENDKEY => 'c'} 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(6908): Opening region: {ENCODED => 5bd5770f4cb5fda71c84441d6be2c0e7, NAME => 'testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.', STARTKEY => '', ENDKEY => 'a'} 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits c24958fa636e29e21028e350d32623fb 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits 1c6cd8294a789f4998b71741869e1aa7 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,924 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits 5bd5770f4cb5fda71c84441d6be2c0e7 2017-12-06 22:42:43,925 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,929 DEBUG [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f1 2017-12-06 22:42:43,929 DEBUG [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f1 2017-12-06 22:42:43,929 DEBUG [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f1 2017-12-06 22:42:43,930 DEBUG [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f1 2017-12-06 22:42:43,929 DEBUG [StoreOpener-c24958fa636e29e21028e350d32623fb-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f1 2017-12-06 22:42:43,930 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,930 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,930 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,930 DEBUG [StoreOpener-c24958fa636e29e21028e350d32623fb-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f1 2017-12-06 22:42:43,930 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,930 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,930 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,931 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,931 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,931 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,931 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,932 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,932 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,934 DEBUG [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f2 2017-12-06 22:42:43,934 DEBUG [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f2 2017-12-06 22:42:43,934 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,935 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,935 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,935 INFO [StoreOpener-5bd5770f4cb5fda71c84441d6be2c0e7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,935 DEBUG [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f2 2017-12-06 22:42:43,936 DEBUG [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f2 2017-12-06 22:42:43,936 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,936 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,936 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,936 DEBUG [StoreOpener-c24958fa636e29e21028e350d32623fb-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f2 2017-12-06 22:42:43,937 DEBUG [StoreOpener-c24958fa636e29e21028e350d32623fb-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f2 2017-12-06 22:42:43,937 INFO [StoreOpener-1c6cd8294a789f4998b71741869e1aa7-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,937 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,937 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,937 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,938 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,938 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,938 INFO [StoreOpener-c24958fa636e29e21028e350d32623fb-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,938 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7 2017-12-06 22:42:43,939 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7 2017-12-06 22:42:43,939 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,940 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb 2017-12-06 22:42:43,941 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:43,941 DEBUG [RS_OPEN_REGION-asf911:43202-1] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:43,942 DEBUG [RS_OPEN_REGION-asf911:43202-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:43,947 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:43,947 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined 1c6cd8294a789f4998b71741869e1aa7; next sequenceid=2 2017-12-06 22:42:43,949 INFO [PostOpenDeployTasks:1c6cd8294a789f4998b71741869e1aa7] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,949 DEBUG [RS_OPEN_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:43,949 INFO [RS_OPEN_REGION-asf911:43202-0] regionserver.HRegion(950): Onlined c24958fa636e29e21028e350d32623fb; next sequenceid=2 2017-12-06 22:42:43,949 DEBUG [RS_OPEN_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:43,950 INFO [RS_OPEN_REGION-asf911:43202-1] regionserver.HRegion(950): Onlined 5bd5770f4cb5fda71c84441d6be2c0e7; next sequenceid=2 2017-12-06 22:42:43,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=101, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,952 INFO [PostOpenDeployTasks:c24958fa636e29e21028e350d32623fb] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,952 DEBUG [PostOpenDeployTasks:1c6cd8294a789f4998b71741869e1aa7] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:42:43,953 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,953 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(6908): Opening region: {ENCODED => e9f2e3d66bf51aa5d73745df63badf9a, NAME => 'testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.', STARTKEY => 'a', ENDKEY => 'b'} 2017-12-06 22:42:43,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=102, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,955 INFO [PostOpenDeployTasks:5bd5770f4cb5fda71c84441d6be2c0e7] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,955 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table testSimpleTruncatePreserveSplits e9f2e3d66bf51aa5d73745df63badf9a 2017-12-06 22:42:43,955 DEBUG [PostOpenDeployTasks:c24958fa636e29e21028e350d32623fb] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:42:43,955 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(799): Instantiated testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,956 DEBUG [RS_OPEN_REGION-asf911:43202-0] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=100, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,957 DEBUG [PostOpenDeployTasks:5bd5770f4cb5fda71c84441d6be2c0e7] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:42:43,958 DEBUG [RS_OPEN_REGION-asf911:43202-1] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,961 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=100 updating hbase:meta row=testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,962 DEBUG [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f1 2017-12-06 22:42:43,962 DEBUG [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f1 2017-12-06 22:42:43,962 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,962 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,963 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] hfile.CacheConfig(258): Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,963 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,966 DEBUG [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f2 2017-12-06 22:42:43,966 DEBUG [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] util.CommonFSUtils(557): Set storagePolicy=HOT for path=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f2 2017-12-06 22:42:43,966 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] regionserver.CompactingMemStore(140): Setting in-memory flush size threshold to 1342177 2017-12-06 22:42:43,966 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] regionserver.HStore(291): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2017-12-06 22:42:43,967 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] hfile.CacheConfig(258): Created cacheConfig for f2: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-12-06 22:42:43,967 INFO [StoreOpener-e9f2e3d66bf51aa5d73745df63badf9a-1] compactions.CompactionConfiguration(145): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2017-12-06 22:42:43,968 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(1023): Setting FlushNonSloppyStoresFirstPolicy for the region=testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,969 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(4326): Found 0 recovered edits file(s) under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a 2017-12-06 22:42:43,971 DEBUG [RS_OPEN_REGION-asf911:43202-2] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of table testSimpleTruncatePreserveSplits, use config (67108864) instead 2017-12-06 22:42:43,974 DEBUG [RS_OPEN_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2017-12-06 22:42:43,974 INFO [RS_OPEN_REGION-asf911:43202-2] regionserver.HRegion(950): Onlined e9f2e3d66bf51aa5d73745df63badf9a; next sequenceid=2 2017-12-06 22:42:43,976 INFO [PostOpenDeployTasks:e9f2e3d66bf51aa5d73745df63badf9a] regionserver.HRegionServer(2204): Post open deploy tasks for testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] assignment.RegionTransitionProcedure(234): Received report OPENED seqId=2, pid=103, ppid=99, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a; rit=OPENING, location=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:43,978 DEBUG [PostOpenDeployTasks:e9f2e3d66bf51aa5d73745df63badf9a] regionserver.HRegionServer(2228): Finished post open deploy task for testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:42:43,979 DEBUG [RS_OPEN_REGION-asf911:43202-2] handler.OpenRegionHandler(129): Opened testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. on asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:44,012 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=100, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7 2017-12-06 22:42:44,012 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=100, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=5bd5770f4cb5fda71c84441d6be2c0e7 in 468msec 2017-12-06 22:42:44,012 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=103 updating hbase:meta row=testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:44,061 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=103, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a 2017-12-06 22:42:44,062 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=103, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=e9f2e3d66bf51aa5d73745df63badf9a in 519msec 2017-12-06 22:42:44,062 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=102 updating hbase:meta row=testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:44,111 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=102, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb 2017-12-06 22:42:44,112 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=102, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=c24958fa636e29e21028e350d32623fb in 568msec 2017-12-06 22:42:44,112 INFO [ProcExecWrkr-1] assignment.RegionStateStore(187): pid=101 updating hbase:meta row=testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7., regionState=OPEN, openSeqNum=2, regionLocation=asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:42:44,161 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1609): Finish suprocedure pid=101, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7 2017-12-06 22:42:44,211 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1615): Finished subprocedure(s) of pid=99, state=RUNNABLE:TRUNCATE_TABLE_POST_OPERATION; TruncateTableProcedure (table=testSimpleTruncatePreserveSplits preserveSplits=true); resume parent processing. 2017-12-06 22:42:44,212 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=101, ppid=99, state=SUCCESS; AssignProcedure table=testSimpleTruncatePreserveSplits, region=1c6cd8294a789f4998b71741869e1aa7 in 618msec 2017-12-06 22:42:44,212 DEBUG [ProcExecWrkr-1] hbase.MetaTableAccessor(1398): Put{"totalColumns":1,"row":"testSimpleTruncatePreserveSplits","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1512600164212}]},"ts":1512600164212} 2017-12-06 22:42:44,215 INFO [ProcExecWrkr-1] hbase.MetaTableAccessor(1770): Updated table testSimpleTruncatePreserveSplits state to ENABLED in META 2017-12-06 22:42:44,216 DEBUG [ProcExecWrkr-1] procedure.TruncateTableProcedure(134): truncate 'testSimpleTruncatePreserveSplits' completed 2017-12-06 22:42:44,260 INFO [ProcExecWrkr-1] procedure2.ProcedureExecutor(1246): Finished pid=99, state=SUCCESS; TruncateTableProcedure (table=testSimpleTruncatePreserveSplits preserveSplits=true) in 2.0060sec 2017-12-06 22:42:44,508 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:42:44,515 INFO [Time-limited test] hbase.Waiter(189): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2017-12-06 22:42:44,520 DEBUG [Time-limited test] util.CommonFSUtils(736): Current file system: 2017-12-06 22:42:44,521 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tabledesc/ 2017-12-06 22:42:44,522 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.tableinfo.0000000001 2017-12-06 22:42:44,522 DEBUG [Time-limited test] util.CommonFSUtils(754): |-.tmp/ 2017-12-06 22:42:44,523 DEBUG [Time-limited test] util.CommonFSUtils(754): |-1c6cd8294a789f4998b71741869e1aa7/ 2017-12-06 22:42:44,524 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:42:44,524 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:42:44,524 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:42:44,525 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:42:44,526 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:42:44,526 DEBUG [Time-limited test] util.CommonFSUtils(754): |-5bd5770f4cb5fda71c84441d6be2c0e7/ 2017-12-06 22:42:44,527 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:42:44,527 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:42:44,527 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:42:44,528 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:42:44,529 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:42:44,529 DEBUG [Time-limited test] util.CommonFSUtils(754): |-c24958fa636e29e21028e350d32623fb/ 2017-12-06 22:42:44,530 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:42:44,530 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:42:44,530 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:42:44,531 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:42:44,532 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:42:44,532 DEBUG [Time-limited test] util.CommonFSUtils(754): |-e9f2e3d66bf51aa5d73745df63badf9a/ 2017-12-06 22:42:44,533 DEBUG [Time-limited test] util.CommonFSUtils(757): |----.regioninfo 2017-12-06 22:42:44,533 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f1/ 2017-12-06 22:42:44,533 DEBUG [Time-limited test] util.CommonFSUtils(754): |----f2/ 2017-12-06 22:42:44,534 DEBUG [Time-limited test] util.CommonFSUtils(754): |----recovered.edits/ 2017-12-06 22:42:44,535 DEBUG [Time-limited test] util.CommonFSUtils(757): |-------2.seqid 2017-12-06 22:42:44,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 233 service: ClientService methodName: Scan size: 138 connection: 67.195.81.155:48320 deadline: 1512600224556 org.apache.hadoop.hbase.NotServingRegionException: testSimpleTruncatePreserveSplits,,1512600155934.2609f83cdaf1e5fdf1bb5aa708582d98. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:42:44,664 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:42:44,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 237 service: ClientService methodName: Scan size: 142 connection: 67.195.81.155:48320 deadline: 1512600224665 org.apache.hadoop.hbase.NotServingRegionException: testSimpleTruncatePreserveSplits,a,1512600155934.01ca9697a8eeddceb04c8ea2b5d19022. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:42:44,772 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:42:44,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 241 service: ClientService methodName: Scan size: 142 connection: 67.195.81.155:48320 deadline: 1512600224773 org.apache.hadoop.hbase.NotServingRegionException: testSimpleTruncatePreserveSplits,b,1512600155934.ef00b25551d15362669b1b0a2873967d. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:42:44,881 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:42:44,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] ipc.CallRunner(141): callId: 245 service: ClientService methodName: Scan size: 142 connection: 67.195.81.155:48320 deadline: 1512600224883 org.apache.hadoop.hbase.NotServingRegionException: testSimpleTruncatePreserveSplits,c,1512600155934.3bdc4b6a5d824e1b9f5f67fc1e5b33dd. is not online on asf911.gq1.ygridcore.net,43202,1512599926033 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3311) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3288) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1346) at org.apache.hadoop.hbase.regionserver.RSRpcServices.newRegionScanner(RSRpcServices.java:2841) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3166) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41548) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305) 2017-12-06 22:42:44,916 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741909_1085, blk_1073741910_1086, blk_1073741911_1087, blk_1073741912_1088, blk_1073741913_1089] 2017-12-06 22:42:44,993 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:44,993 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:44,994 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:44,994 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=43202] regionserver.HRegion(8092): writing data to region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. with WAL disabled. Data may be lost in the event of a crash. 2017-12-06 22:42:44,998 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'a', inclusive 2017-12-06 22:42:45,000 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'b', inclusive 2017-12-06 22:42:45,002 DEBUG [Time-limited test] client.ClientScanner(241): Advancing internal scanner to startKey at 'c', inclusive 2017-12-06 22:42:45,005 WARN [Time-limited test] procedure2.ProcedureTestingUtility(146): Set Kill before store update to: false 2017-12-06 22:42:45,012 INFO [Time-limited test] procedure.TestTableDDLProcedureBase(67): Tear down, remove table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:45,013 INFO [Time-limited test] client.HBaseAdmin$15(895): Started disable of testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:45,014 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.HMaster$8(2284): Client=jenkins//67.195.81.155 disable testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:45,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] procedure2.ProcedureExecutor(868): Stored pid=104, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:45,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:45,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:45,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:45,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:46,202 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:42:46,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:47,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:47,894 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:48,759 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:42:48,761 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:42:48,762 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1191 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:42:48,763 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:42:48,764 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:42:48,764 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:42:48,764 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1401 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:42:48,764 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:42:48,765 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:42:48,766 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:42:48,766 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:42:48,766 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:42:48,766 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1402 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:42:48,768 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:42:48,772 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:42:48,772 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits and itself. 2017-12-06 22:42:48,772 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:42:48,773 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:42:48,773 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:42:48,773 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:42:48,773 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:42:48,773 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:42:48,774 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:42:48,775 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:42:48,776 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:42:48,777 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:42:48,777 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:42:48,777 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:42:48,777 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 and itself. 2017-12-06 22:42:48,777 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:48,778 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:48,779 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:42:48,779 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:42:48,779 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:48,779 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:42:48,780 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:42:48,780 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:42:48,780 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:42:48,781 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:42:48,782 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:48,782 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:48,782 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:42:48,782 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 and itself. 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:48,783 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 with reasons: undeletable, please check. 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable with reasons: undeletable, please check. 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:42:48,784 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,785 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:42:48,787 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 and itself. 2017-12-06 22:42:48,786 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:42:48,787 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:42:48,787 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:42:48,788 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:42:48,788 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:42:48,788 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:48,788 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:42:48,789 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:42:48,790 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:42:48,790 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits and itself. 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:42:48,791 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:42:48,792 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,792 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:42:48,792 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:42:48,793 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:42:48,793 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:42:48,793 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:42:48,794 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 with reasons: undeletable, please check. 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd and itself. 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:42:48,796 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:42:48,797 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:48,797 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,798 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:42:48,798 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:42:48,798 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:42:48,799 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,799 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:42:48,799 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:42:48,800 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:42:48,799 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:48,799 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:42:48,800 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:42:48,800 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:48,800 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:42:48,800 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 and itself. 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:42:48,801 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:42:48,802 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:48,802 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:48,802 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,803 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:42:48,803 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:42:48,803 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:42:48,803 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:42:48,803 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 and itself. 2017-12-06 22:42:48,804 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:42:48,806 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:42:48,807 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:42:48,807 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:42:48,808 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,808 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:42:48,808 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:42:48,808 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 with reasons: undeletable, please check. 2017-12-06 22:42:48,808 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:42:48,809 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,810 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:42:48,810 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:42:48,810 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:42:48,817 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f with reasons: undeletable, please check. 2017-12-06 22:42:48,817 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:42:48,819 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:42:48,819 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:42:48,818 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits and itself. 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff with reasons: undeletable, please check. 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:42:48,820 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,822 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:42:48,822 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:42:48,822 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 with reasons: undeletable, please check. 2017-12-06 22:42:48,821 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:42:48,823 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:42:48,824 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:42:48,824 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:42:48,824 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:42:48,825 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:42:48,825 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,825 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:42:48,825 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:42:48,826 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:42:48,828 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:42:48,828 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:42:48,828 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:42:48,829 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:42:48,827 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:42:48,829 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:42:48,829 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:42:48,829 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,829 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd with reasons: undeletable, please check. 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 and itself. 2017-12-06 22:42:48,830 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:42:48,831 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:42:48,831 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,831 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:42:48,832 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:48,832 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:42:48,832 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:48,834 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:42:48,834 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 and itself. 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:42:48,834 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:42:48,833 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:42:48,834 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:48,835 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:48,837 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:42:48,837 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:42:48,838 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:42:48,840 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 with reasons: undeletable, please check. 2017-12-06 22:42:48,841 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:42:48,841 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,842 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:48,842 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:42:48,842 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 and itself. 2017-12-06 22:42:48,843 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:42:48,843 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:42:48,844 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:42:48,846 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 with reasons: undeletable, please check. 2017-12-06 22:42:48,845 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:42:48,846 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:42:48,846 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:42:48,847 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,847 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:42:48,847 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:42:48,847 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:42:48,848 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:42:48,848 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:42:48,848 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,849 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:42:48,849 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:42:48,849 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 with reasons: undeletable, please check. 2017-12-06 22:42:48,849 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:42:48,849 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:42:48,850 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,850 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:48,850 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:42:48,850 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits and itself. 2017-12-06 22:42:48,851 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:42:48,851 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:42:48,851 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c with reasons: undeletable, please check. 2017-12-06 22:42:48,852 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:42:48,853 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1410 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:42:48,854 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:42:48,854 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:42:48,855 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:42:48,855 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:42:48,857 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:42:48,856 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:42:48,857 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:42:48,857 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1410 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:42:48,859 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 with reasons: undeletable, please check. 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:42:48,860 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d and itself. 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:42:48,861 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:42:48,863 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:42:48,864 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1410 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 and itself. 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:42:48,865 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:42:48,866 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:42:48,866 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:48,866 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:48,866 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:42:48,866 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:42:48,867 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,867 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:42:48,867 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:42:48,868 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,868 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:48,868 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:42:48,868 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 and itself. 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:42:48,870 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1410 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:42:48,871 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:42:48,871 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:42:48,871 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,872 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:42:48,872 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:42:48,872 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:42:48,873 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1403 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:42:48,875 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:42:48,876 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,876 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:42:48,876 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:42:48,876 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:42:48,877 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:42:48,876 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 with reasons: undeletable, please check. 2017-12-06 22:42:48,878 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1410 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:42:48,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:48,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:42:48,880 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1405 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits and itself. 2017-12-06 22:42:48,880 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:42:48,881 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 with reasons: undeletable, please check. 2017-12-06 22:42:48,882 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,882 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1407 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:42:48,882 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1408 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:42:48,882 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 with reasons: undeletable, please check. 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1409 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:42:48,883 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:42:48,884 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:42:48,884 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:42:48,884 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:42:48,885 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:42:48,885 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,885 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:42:48,885 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:42:48,886 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 with reasons: undeletable, please check. 2017-12-06 22:42:48,886 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:42:48,885 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:42:48,886 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:42:48,887 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,887 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:42:48,887 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:42:48,887 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 with reasons: undeletable, please check. 2017-12-06 22:42:48,888 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,888 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:42:48,888 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:42:48,890 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 with reasons: undeletable, please check. 2017-12-06 22:42:48,890 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:42:48,890 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:42:48,891 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 with reasons: undeletable, please check. 2017-12-06 22:42:48,891 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:42:48,891 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:42:48,891 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 with reasons: undeletable, please check. 2017-12-06 22:42:48,891 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d with reasons: undeletable, please check. 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits with reasons: undeletable, please check. 2017-12-06 22:42:48,893 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:42:48,894 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:42:48,894 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:42:48,894 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:42:49,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:49,427 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:42:49,450 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2017-12-06 22:42:50,685 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:42:52,860 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x2ddabd09 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:42:52,894 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:42:53,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:42:55,702 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:42:57,895 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:02,895 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:03,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:43:07,897 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:12,898 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:13,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:43:17,899 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:22,900 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:23,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:43:27,900 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:32,900 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:33,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:43:37,901 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:42,902 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:45,442 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache(956): totalSize=747.70 KB, freeSize=994.87 MB, max=995.60 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2017-12-06 22:43:46,026 DEBUG [asf911:39318.masterManager-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(338): Stats: current pool size=0,created chunk count=11,reused chunk count=36,reuseRatio=76.60% 2017-12-06 22:43:46,202 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:43:47,816 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:43:47,902 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:43:48,014 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:43:48,015 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1406 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:43:48,016 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:43:48,016 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:43:48,016 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1404 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:43:48,016 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:43:48,016 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:43:48,017 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:43:48,017 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:43:48,017 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:43:48,017 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:43:48,017 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1419 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:43:48,018 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:43:48,025 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:43:48,024 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits and itself. 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:43:48,029 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:43:48,028 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:43:48,030 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:43:48,030 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:43:48,031 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:43:48,034 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:43:48,035 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 and itself. 2017-12-06 22:43:48,036 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:43:48,037 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:43:48,038 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 with reasons: undeletable, please check. 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable with reasons: undeletable, please check. 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:43:48,039 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 and itself. 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:43:48,040 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:43:48,041 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:43:48,043 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:43:48,043 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:43:48,042 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:43:48,043 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:43:48,043 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,043 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:43:48,044 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:43:48,045 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:43:48,046 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,046 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:43:48,046 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:43:48,046 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 and itself. 2017-12-06 22:43:48,046 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:43:48,047 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:43:48,047 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:43:48,047 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,048 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:43:48,048 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:43:48,048 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:43:48,048 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:43:48,049 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:43:48,049 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:43:48,049 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,049 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:43:48,050 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:43:48,050 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:43:48,051 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff with reasons: undeletable, please check. 2017-12-06 22:43:48,052 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:43:48,053 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,054 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:43:48,054 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:43:48,054 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:43:48,054 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits and itself. 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:43:48,055 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:43:48,056 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,057 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:43:48,057 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:43:48,057 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:43:48,057 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:43:48,057 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:43:48,058 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,058 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:43:48,058 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:43:48,058 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 with reasons: undeletable, please check. 2017-12-06 22:43:48,058 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:43:48,059 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:43:48,059 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:43:48,060 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:43:48,060 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,060 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:43:48,060 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:43:48,060 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,062 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:43:48,062 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:43:48,062 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 with reasons: undeletable, please check. 2017-12-06 22:43:48,061 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:43:48,062 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:43:48,062 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 with reasons: undeletable, please check. 2017-12-06 22:43:48,063 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd and itself. 2017-12-06 22:43:48,064 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:43:48,064 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,064 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:43:48,065 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:43:48,065 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:43:48,065 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:43:48,065 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:43:48,065 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:43:48,066 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:43:48,068 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 and itself. 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:43:48,067 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:43:48,068 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 with reasons: undeletable, please check. 2017-12-06 22:43:48,068 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:43:48,068 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1426 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 with reasons: undeletable, please check. 2017-12-06 22:43:48,069 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:43:48,070 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:43:48,070 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1427 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:43:48,070 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:43:48,071 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:43:48,072 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1420 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:43:48,074 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:43:48,073 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1427 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:43:48,074 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:43:48,074 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:43:48,074 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,075 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:43:48,075 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:43:48,075 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 and itself. 2017-12-06 22:43:48,075 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:43:48,075 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f with reasons: undeletable, please check. 2017-12-06 22:43:48,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1429 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:43:48,077 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:43:48,078 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:43:48,078 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:43:48,078 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:43:48,078 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:43:48,079 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,079 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:43:48,079 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:43:48,079 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:43:48,080 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:43:48,080 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:43:48,080 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:43:48,080 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:43:48,080 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:43:48,081 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1426 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:43:48,085 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:43:48,085 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,085 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:43:48,085 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:43:48,086 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:43:48,086 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits and itself. 2017-12-06 22:43:48,086 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:43:48,091 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:43:48,091 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:43:48,091 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:43:48,090 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1430 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:43:48,091 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,092 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:43:48,092 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:43:48,092 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1426 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:43:48,093 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:43:48,093 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:43:48,093 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:43:48,093 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:43:48,093 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:43:48,099 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,099 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:43:48,099 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:43:48,099 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 with reasons: undeletable, please check. 2017-12-06 22:43:48,099 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 and itself. 2017-12-06 22:43:48,100 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1431 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d and itself. 2017-12-06 22:43:48,100 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:43:48,101 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:43:48,101 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:43:48,101 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,102 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:43:48,102 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:43:48,102 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:43:48,102 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1430 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:43:48,102 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:43:48,101 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:43:48,104 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,104 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:43:48,106 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:43:48,106 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:43:48,106 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:43:48,106 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1431 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 and itself. 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:43:48,106 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:43:48,105 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1425 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 and itself. 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1429 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c with reasons: undeletable, please check. 2017-12-06 22:43:48,108 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1426 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:43:48,107 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1427 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:43:48,110 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,112 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:43:48,112 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:43:48,111 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:43:48,117 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:43:48,112 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:43:48,117 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd with reasons: undeletable, please check. 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1423 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 and itself. 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:43:48,118 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1429 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1426 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:43:48,119 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,120 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:43:48,120 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:43:48,120 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1432 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits and itself. 2017-12-06 22:43:48,120 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:43:48,120 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:43:48,122 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:43:48,122 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:43:48,122 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 with reasons: undeletable, please check. 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1427 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:43:48,123 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1421 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:43:48,126 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:43:48,127 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:43:48,128 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:43:48,129 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:43:48,128 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,130 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:43:48,130 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:43:48,131 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1432 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 and itself. 2017-12-06 22:43:48,128 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:43:48,131 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:43:48,130 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,131 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:43:48,131 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:43:48,131 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1433 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 with reasons: undeletable, please check. 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1424 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:43:48,133 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:43:48,133 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:43:48,135 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,135 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:43:48,135 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:43:48,132 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1422 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:43:48,133 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,135 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1432 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits and itself. 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:43:48,136 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:43:48,137 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:43:48,137 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:43:48,137 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:43:48,138 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,138 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:43:48,138 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:43:48,138 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1433 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1427 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:43:48,139 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:43:48,140 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:43:48,140 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:43:48,140 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,141 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:43:48,141 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:43:48,142 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,142 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:43:48,142 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:43:48,142 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 with reasons: undeletable, please check. 2017-12-06 22:43:48,142 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:43:48,143 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,143 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:43:48,143 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:43:48,144 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 with reasons: undeletable, please check. 2017-12-06 22:43:48,144 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:43:48,145 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:43:48,145 DEBUG [ForkJoinPool-1-worker-8] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 with reasons: undeletable, please check. 2017-12-06 22:43:48,145 DEBUG [ForkJoinPool-1-worker-9] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:43:48,146 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,146 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:43:48,146 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:43:48,146 DEBUG [ForkJoinPool-1-worker-2] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 with reasons: undeletable, please check. 2017-12-06 22:43:48,147 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,147 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:43:48,147 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:43:48,148 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 with reasons: undeletable, please check. 2017-12-06 22:43:48,149 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:43:48,149 DEBUG [ForkJoinPool-1-worker-19] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:43:48,149 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 with reasons: undeletable, please check. 2017-12-06 22:43:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:43:48,150 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:43:48,150 DEBUG [ForkJoinPool-1-worker-10] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d with reasons: undeletable, please check. 2017-12-06 22:43:48,150 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits with reasons: undeletable, please check. 2017-12-06 22:43:48,151 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:43:48,151 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:43:48,151 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:43:48,151 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 with reasons: undeletable, please check. 2017-12-06 22:43:48,152 DEBUG [ForkJoinPool-1-worker-5] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits with reasons: undeletable, please check. 2017-12-06 22:43:48,153 DEBUG [ForkJoinPool-1-worker-12] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:43:48,154 DEBUG [ForkJoinPool-1-worker-13] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:43:48,154 DEBUG [ForkJoinPool-1-worker-15] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:43:48,154 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:43:48,843 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:43:50,685 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:43:50,892 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because table has an old edit so flush to free WALs after random delay 269623ms 2017-12-06 22:43:51,026 INFO [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.HMaster(1387): Not running balancer because 1 region(s) in transition: [rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978] 2017-12-06 22:43:51,032 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.HMaster(1515): Skipping normalization for table: testSimpleTruncatePreserveSplits, as it's either system table or doesn't have auto normalization turned on 2017-12-06 22:43:51,032 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.HMaster(1515): Skipping normalization for table: hbase:meta, as it's either system table or doesn't have auto normalization turned on 2017-12-06 22:43:51,032 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.HMaster(1515): Skipping normalization for table: hbase:namespace, as it's either system table or doesn't have auto normalization turned on 2017-12-06 22:43:51,032 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.HMaster(1515): Skipping normalization for table: testRecoveryAndDoubleExecutionPreserveSplits, as it's either system table or doesn't have auto normalization turned on 2017-12-06 22:43:51,033 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] master.CatalogJanitor(121): CatalogJanitor is disabled! Enabled=true, maintenanceMode=false, am=org.apache.hadoop.hbase.master.assignment.AssignmentManager@f61a80e, failoverCleanupDone=true, hasRIT=true 2017-12-06 22:43:51,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 413ms 2017-12-06 22:43:52,860 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x2ddabd09 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:43:52,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 71424ms 2017-12-06 22:43:52,894 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188634ms 2017-12-06 22:43:52,903 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:53,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:43:53,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 267440ms 2017-12-06 22:43:53,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101573ms 2017-12-06 22:43:54,955 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 138754ms 2017-12-06 22:43:54,955 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72985ms 2017-12-06 22:43:55,702 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:43:55,935 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 142386ms 2017-12-06 22:43:55,935 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299869ms 2017-12-06 22:43:55,941 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-12-06 22:43:56,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 170611ms 2017-12-06 22:43:56,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285710ms 2017-12-06 22:43:57,903 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:43:57,956 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 293527ms 2017-12-06 22:43:57,956 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116503ms 2017-12-06 22:43:58,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 203050ms 2017-12-06 22:43:58,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275308ms 2017-12-06 22:43:59,892 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 31105ms 2017-12-06 22:43:59,892 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191859ms 2017-12-06 22:44:00,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 252359ms 2017-12-06 22:44:00,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163774ms 2017-12-06 22:44:01,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 59524ms 2017-12-06 22:44:01,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26973ms 2017-12-06 22:44:02,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 54220ms 2017-12-06 22:44:02,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155837ms 2017-12-06 22:44:02,904 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:03,972 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 81681ms 2017-12-06 22:44:03,973 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256819ms 2017-12-06 22:44:04,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 53404ms 2017-12-06 22:44:04,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56443ms 2017-12-06 22:44:05,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 120863ms 2017-12-06 22:44:05,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291811ms 2017-12-06 22:44:06,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 145999ms 2017-12-06 22:44:06,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235708ms 2017-12-06 22:44:07,904 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:07,923 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 175640ms 2017-12-06 22:44:07,923 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252819ms 2017-12-06 22:44:08,945 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 129327ms 2017-12-06 22:44:08,945 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164068ms 2017-12-06 22:44:09,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 100573ms 2017-12-06 22:44:09,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258459ms 2017-12-06 22:44:10,968 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 73426ms 2017-12-06 22:44:10,969 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260939ms 2017-12-06 22:44:11,903 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 228151ms 2017-12-06 22:44:11,903 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208972ms 2017-12-06 22:44:12,904 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:12,913 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 35924ms 2017-12-06 22:44:12,913 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85549ms 2017-12-06 22:44:13,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:44:13,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 119771ms 2017-12-06 22:44:13,891 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19252ms 2017-12-06 22:44:14,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 21232ms 2017-12-06 22:44:14,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183391ms 2017-12-06 22:44:15,921 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 238937ms 2017-12-06 22:44:15,921 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135001ms 2017-12-06 22:44:16,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 98587ms 2017-12-06 22:44:16,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166620ms 2017-12-06 22:44:17,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 110562ms 2017-12-06 22:44:17,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61667ms 2017-12-06 22:44:17,905 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:18,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 67933ms 2017-12-06 22:44:18,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191741ms 2017-12-06 22:44:19,951 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 92019ms 2017-12-06 22:44:19,993 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188055ms 2017-12-06 22:44:20,892 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 188012ms 2017-12-06 22:44:20,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218982ms 2017-12-06 22:44:21,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 30530ms 2017-12-06 22:44:21,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50941ms 2017-12-06 22:44:22,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 211335ms 2017-12-06 22:44:22,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39741ms 2017-12-06 22:44:22,905 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:23,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 188932ms 2017-12-06 22:44:23,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46979ms 2017-12-06 22:44:24,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 176141ms 2017-12-06 22:44:24,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113910ms 2017-12-06 22:44:25,908 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 46488ms 2017-12-06 22:44:25,909 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24890ms 2017-12-06 22:44:26,928 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 252631ms 2017-12-06 22:44:26,928 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121834ms 2017-12-06 22:44:27,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 71604ms 2017-12-06 22:44:27,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105790ms 2017-12-06 22:44:27,905 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:28,958 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 45432ms 2017-12-06 22:44:28,958 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5126ms 2017-12-06 22:44:29,946 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 33258ms 2017-12-06 22:44:29,946 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264148ms 2017-12-06 22:44:30,943 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 43344ms 2017-12-06 22:44:30,943 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17952ms 2017-12-06 22:44:31,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 299574ms 2017-12-06 22:44:31,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27148ms 2017-12-06 22:44:32,894 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 154343ms 2017-12-06 22:44:32,894 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295204ms 2017-12-06 22:44:32,906 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:44:33,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 112199ms 2017-12-06 22:44:33,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137221ms 2017-12-06 22:44:34,920 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 138764ms 2017-12-06 22:44:34,920 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90124ms 2017-12-06 22:44:35,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 213639ms 2017-12-06 22:44:35,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246639ms 2017-12-06 22:44:36,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 278634ms 2017-12-06 22:44:36,893 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52558ms 2017-12-06 22:44:37,907 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:37,980 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 57129ms 2017-12-06 22:44:37,980 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136940ms 2017-12-06 22:44:38,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 222020ms 2017-12-06 22:44:38,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228143ms 2017-12-06 22:44:39,925 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 67662ms 2017-12-06 22:44:39,925 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85296ms 2017-12-06 22:44:40,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 288557ms 2017-12-06 22:44:40,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192181ms 2017-12-06 22:44:41,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 273844ms 2017-12-06 22:44:41,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136936ms 2017-12-06 22:44:42,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 158214ms 2017-12-06 22:44:42,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105595ms 2017-12-06 22:44:42,908 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:43,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 128284ms 2017-12-06 22:44:43,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136055ms 2017-12-06 22:44:43,924 DEBUG [RS-EventLoopGroup-3-21] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:48314. Number of active connections: 2 2017-12-06 22:44:44,118 DEBUG [RS-EventLoopGroup-3-19] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:48312. Number of active connections: 1 2017-12-06 22:44:44,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 274549ms 2017-12-06 22:44:44,890 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243837ms 2017-12-06 22:44:45,010 DEBUG [RS-EventLoopGroup-3-22] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:48320. Number of active connections: 0 2017-12-06 22:44:45,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 178390ms 2017-12-06 22:44:45,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8122ms 2017-12-06 22:44:46,203 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x5adb9ac4 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:44:46,942 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 89374ms 2017-12-06 22:44:46,942 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63827ms 2017-12-06 22:44:47,900 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 295339ms 2017-12-06 22:44:47,900 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77037ms 2017-12-06 22:44:47,908 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:48,844 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x27c4e38f no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:44:48,949 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 112161ms 2017-12-06 22:44:48,949 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260891ms 2017-12-06 22:44:49,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 122727ms 2017-12-06 22:44:49,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92295ms 2017-12-06 22:44:50,686 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x3fa528d8 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:44:50,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 257327ms 2017-12-06 22:44:50,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259055ms 2017-12-06 22:44:51,875 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs and itself. 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:44:51,879 DEBUG [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(222): Cleaned old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs successfully. 2017-12-06 22:44:51,880 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1428 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive and itself. 2017-12-06 22:44:51,881 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:44:51,882 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:44:51,882 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:44:51,882 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1441 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data and itself. 2017-12-06 22:44:51,882 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive 2017-12-06 22:44:51,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:44:51,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:44:51,883 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1442 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default and itself. 2017-12-06 22:44:51,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:44:51,883 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data 2017-12-06 22:44:51,884 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:44:51,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 212801ms 2017-12-06 22:44:51,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53153ms 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits and itself. 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits and itself. 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits and itself. 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:44:51,889 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default 2017-12-06 22:44:51,890 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:51,890 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:44:51,888 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits and itself. 2017-12-06 22:44:51,890 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable and itself. 2017-12-06 22:44:51,890 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:51,892 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:51,892 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:44:51,892 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:44:51,892 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits 2017-12-06 22:44:51,892 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 and itself. 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 and itself. 2017-12-06 22:44:51,893 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff and itself. 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,894 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 and itself. 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,895 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 and itself. 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 and itself. 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,896 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 and itself. 2017-12-06 22:44:51,898 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 and itself. 2017-12-06 22:44:51,897 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits and itself. 2017-12-06 22:44:51,898 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,898 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,898 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 and itself. 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,899 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:44:51,900 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,900 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,901 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1/27585d74d4a44ae4bd4ac2bb92e8975f from archive 2017-12-06 22:44:51,902 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 with reasons: undeletable, please check. 2017-12-06 22:44:51,902 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:44:51,902 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f1 2017-12-06 22:44:51,902 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 and itself. 2017-12-06 22:44:51,903 INFO [IPC Server handler 2 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:55766 2017-12-06 22:44:51,903 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,903 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,903 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,904 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1/e09a2866e8c244858f960fbb499b8a5e from archive 2017-12-06 22:44:51,904 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:44:51,904 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:44:51,904 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741864_1040 127.0.0.1:55766 2017-12-06 22:44:51,904 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,905 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,905 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,905 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,905 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits/4.seqid from archive 2017-12-06 22:44:51,905 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,907 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,907 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,907 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,908 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,908 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f1 2017-12-06 22:44:51,912 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 with reasons: undeletable, please check. 2017-12-06 22:44:51,913 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:44:51,913 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/f2 2017-12-06 22:44:51,914 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits and itself. 2017-12-06 22:44:51,909 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57/recovered.edits 2017-12-06 22:44:51,908 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f1 2017-12-06 22:44:51,915 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:44:51,916 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:44:51,915 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,915 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1/27ddc7d86f4443afb0a621e4e08403ca from archive 2017-12-06 22:44:51,913 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 and itself. 2017-12-06 22:44:51,916 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,917 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:55766 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable/16ae9a4c9c9aeb4e00dd8526d08c5b57 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,915 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 and itself. 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,919 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,919 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,919 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,918 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:44:51,920 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:44:51,920 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98/recovered.edits 2017-12-06 22:44:51,920 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/2609f83cdaf1e5fdf1bb5aa708582d98 with reasons: undeletable, please check. 2017-12-06 22:44:51,919 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testTruncateNotDisabledTable 2017-12-06 22:44:51,920 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 and itself. 2017-12-06 22:44:51,920 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd and itself. 2017-12-06 22:44:51,921 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f1 2017-12-06 22:44:51,921 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 and itself. 2017-12-06 22:44:51,921 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,926 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,930 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:44:51,936 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:44:51,936 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2/2976f5086a19427f80e77fcb45034b59 from archive 2017-12-06 22:44:51,936 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,936 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,937 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:55766 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,938 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 and itself. 2017-12-06 22:44:51,939 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/f2 2017-12-06 22:44:51,939 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits and itself. 2017-12-06 22:44:51,940 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:44:51,940 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:44:51,940 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,940 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,943 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2/d9fd25ae16e04cc3a44dd709847989ef from archive 2017-12-06 22:44:51,944 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:55766 2017-12-06 22:44:51,944 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:44:51,944 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:44:51,944 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 2017-12-06 22:44:51,944 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,945 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,945 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,945 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,944 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 and itself. 2017-12-06 22:44:51,946 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/f2 2017-12-06 22:44:51,946 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits and itself. 2017-12-06 22:44:51,947 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits/8.seqid from archive 2017-12-06 22:44:51,948 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:44:51,948 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:44:51,949 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,950 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,950 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,950 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,950 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,950 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,951 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 with reasons: undeletable, please check. 2017-12-06 22:44:51,951 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:44:51,951 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f1 2017-12-06 22:44:51,951 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 and itself. 2017-12-06 22:44:51,951 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8/recovered.edits 2017-12-06 22:44:51,952 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,952 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,952 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:44:51,953 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:44:51,953 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/ed4335ddaae62ee3b1bd6b1510661cf8 2017-12-06 22:44:51,953 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2/3703cf8da53e47ccb884d5b63156710f from archive 2017-12-06 22:44:51,953 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f and itself. 2017-12-06 22:44:51,954 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:55766 2017-12-06 22:44:51,954 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,954 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,954 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,955 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,955 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,955 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 with reasons: undeletable, please check. 2017-12-06 22:44:51,955 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:44:51,956 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/f2 2017-12-06 22:44:51,956 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits and itself. 2017-12-06 22:44:51,956 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/f2 2017-12-06 22:44:51,956 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits and itself. 2017-12-06 22:44:51,957 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits/8.seqid from archive 2017-12-06 22:44:51,957 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,957 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,958 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,958 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 and itself. 2017-12-06 22:44:51,958 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,958 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,959 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,958 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:44:51,959 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:44:51,959 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,960 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,959 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,960 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,960 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,959 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 with reasons: undeletable, please check. 2017-12-06 22:44:51,961 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:44:51,961 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f1 2017-12-06 22:44:51,961 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 and itself. 2017-12-06 22:44:51,963 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:44:51,964 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:44:51,963 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff/recovered.edits 2017-12-06 22:44:51,964 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,964 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,968 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits/8.seqid from archive 2017-12-06 22:44:51,969 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a8c2a7e503bc2d570402d09ea53378ff 2017-12-06 22:44:51,969 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 and itself. 2017-12-06 22:44:51,970 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,970 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,970 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,970 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,970 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 with reasons: undeletable, please check. 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/f2 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits and itself. 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4/recovered.edits 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,971 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,972 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/5e438ded1a553f64ae16215522e079c4 2017-12-06 22:44:51,972 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 and itself. 2017-12-06 22:44:51,973 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:44:51,973 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:44:51,973 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:51,973 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:51,973 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1/2e0c4f76274e4b8ea22ed459227ad8ec from archive 2017-12-06 22:44:51,973 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:51,974 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 and itself. 2017-12-06 22:44:51,974 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:51,974 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:55766 2017-12-06 22:44:51,975 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,975 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,975 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,975 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,977 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f1 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd/recovered.edits 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 and itself. 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/3bdc4b6a5d824e1b9f5f67fc1e5b33dd with reasons: undeletable, please check. 2017-12-06 22:44:51,978 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:51,979 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:51,979 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:51,979 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 and itself. 2017-12-06 22:44:51,980 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:44:51,980 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:44:51,980 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022/recovered.edits 2017-12-06 22:44:51,980 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/01ca9697a8eeddceb04c8ea2b5d19022 with reasons: undeletable, please check. 2017-12-06 22:44:51,980 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d and itself. 2017-12-06 22:44:51,983 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,983 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,983 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,984 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,984 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 and itself. 2017-12-06 22:44:51,984 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:44:51,985 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:51,985 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1/2520b86a3ee64cf0a2d69899a23f6849 from archive 2017-12-06 22:44:51,986 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741879_1055 127.0.0.1:55766 2017-12-06 22:44:51,986 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:44:51,986 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:44:51,986 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d 2017-12-06 22:44:51,987 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,987 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 and itself. 2017-12-06 22:44:51,987 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,987 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2/710c0204c5254b7f884dbcc856bae4d6 from archive 2017-12-06 22:44:51,987 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,988 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,988 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:55766 2017-12-06 22:44:51,988 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:44:51,988 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:44:51,988 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1/1dc2a18f8ec2471390f951d1c17da617 from archive 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f1 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 and itself. 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:51,989 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 and itself. 2017-12-06 22:44:51,989 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:55766 2017-12-06 22:44:51,990 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,990 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,990 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,991 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,992 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 with reasons: undeletable, please check. 2017-12-06 22:44:51,992 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:44:51,992 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f1 2017-12-06 22:44:51,992 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 and itself. 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/f2 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits and itself. 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f1 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 and itself. 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,993 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:51,994 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:51,994 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:44:51,994 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:44:51,994 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,995 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,995 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,995 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,995 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1/87d60f4fe6864703837c3883a9bbca08 from archive 2017-12-06 22:44:51,996 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:55766 2017-12-06 22:44:51,996 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,996 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,996 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,997 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits/9.seqid from archive 2017-12-06 22:44:51,997 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,997 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,997 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,998 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,998 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,997 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f1 2017-12-06 22:44:51,998 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2/8e7579eb72aa48059977accf50a3651f from archive 2017-12-06 22:44:51,998 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 and itself. 2017-12-06 22:44:51,998 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f/recovered.edits 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:51,999 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:55766 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 with reasons: undeletable, please check. 2017-12-06 22:44:52,000 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:51,999 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,000 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:44:52,000 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/f2 2017-12-06 22:44:52,001 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits and itself. 2017-12-06 22:44:52,001 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/f2 2017-12-06 22:44:52,001 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits and itself. 2017-12-06 22:44:52,001 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2/d7e8ad6f396b4829b654627d4bea4cd3 from archive 2017-12-06 22:44:52,001 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,001 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/6112de920b0f89fee9cdf717b720b96f 2017-12-06 22:44:52,002 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 and itself. 2017-12-06 22:44:52,002 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:55766 2017-12-06 22:44:52,002 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:52,002 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,002 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:44:52,003 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2/60a5afb07eeb41c5af11bd377c467133 from archive 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,004 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/f2 2017-12-06 22:44:52,004 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits and itself. 2017-12-06 22:44:52,003 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:44:52,004 INFO [IPC Server handler 0 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:55766 2017-12-06 22:44:52,004 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,004 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,005 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/f2 2017-12-06 22:44:52,005 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits and itself. 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,011 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete files completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits with reasons: undeletable, please check. 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d/recovered.edits 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 and itself. 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0/recovered.edits 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits/ef00b25551d15362669b1b0a2873967d with reasons: undeletable, please check. 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncatePreserveSplits with reasons: undeletable, please check. 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 and itself. 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c and itself. 2017-12-06 22:44:52,012 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:52,013 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,014 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,013 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits/9.seqid from archive 2017-12-06 22:44:52,014 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/952d01842eadd6d92f061dc09880e3a0 2017-12-06 22:44:52,014 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1449 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 and itself. 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,015 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,016 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059/recovered.edits 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,016 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/afe69639e9a13c04ca437d3e5f209059 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 and itself. 2017-12-06 22:44:52,017 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1449 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 and itself. 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 and itself. 2017-12-06 22:44:52,018 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1/ffd1a01fc6da4af59cfde00e24709c75 from archive 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1450 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 and itself. 2017-12-06 22:44:52,018 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9/recovered.edits 2017-12-06 22:44:52,019 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,019 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,019 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:52,019 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:52,020 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:55766 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,021 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,021 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/6e0328adbd37a167dccc80b8dd2b0de9 2017-12-06 22:44:52,021 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1/a5e85f74ee44418284571e5f37a75237 from archive 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,022 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,022 INFO [IPC Server handler 7 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:55766 2017-12-06 22:44:52,020 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,022 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f1 2017-12-06 22:44:52,022 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 and itself. 2017-12-06 22:44:52,021 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 and itself. 2017-12-06 22:44:52,021 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 and itself. 2017-12-06 22:44:52,022 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1/284f7c3f17eb4694a7e495fbde2ef7ae from archive 2017-12-06 22:44:52,022 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,024 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,024 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,024 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1/fe81a75729ab482d91bb91e63b7363e3 from archive 2017-12-06 22:44:52,024 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,025 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,024 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741859_1035 127.0.0.1:55766 2017-12-06 22:44:52,024 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,026 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,026 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,026 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741860_1036 127.0.0.1:55766 2017-12-06 22:44:52,027 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,026 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,030 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,027 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,031 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,031 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,031 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1450 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 and itself. 2017-12-06 22:44:52,027 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,032 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,032 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,032 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,027 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f1 2017-12-06 22:44:52,032 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2/48355fc91bc846169222fa331290cc9b from archive 2017-12-06 22:44:52,031 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f1 2017-12-06 22:44:52,031 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 and itself. 2017-12-06 22:44:52,030 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2/2489c7bfc0124feca15a52b8faf88ed1 from archive 2017-12-06 22:44:52,033 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1449 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 and itself. 2017-12-06 22:44:52,033 INFO [IPC Server handler 3 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:55766 2017-12-06 22:44:52,032 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1445 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 and itself. 2017-12-06 22:44:52,034 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,034 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,033 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f1 2017-12-06 22:44:52,034 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,034 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:55766 2017-12-06 22:44:52,035 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1444 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits and itself. 2017-12-06 22:44:52,035 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,035 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,035 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,036 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,035 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,036 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,036 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,036 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,036 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/f2 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits and itself. 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,038 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,037 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,038 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1/d3429c5796bd4176b612056fdc0a0f0b from archive 2017-12-06 22:44:52,038 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,039 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/f2 2017-12-06 22:44:52,039 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits and itself. 2017-12-06 22:44:52,039 INFO [IPC Server handler 1 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:55766 2017-12-06 22:44:52,039 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,040 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,040 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,042 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,042 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,042 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,046 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,046 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,046 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,046 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f1 2017-12-06 22:44:52,047 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1450 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 and itself. 2017-12-06 22:44:52,047 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,047 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,047 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,047 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,048 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,048 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,048 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c/recovered.edits 2017-12-06 22:44:52,048 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1/d55ab47690a34c658d77071745095951 from archive 2017-12-06 22:44:52,048 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,049 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,049 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:55766 2017-12-06 22:44:52,050 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,050 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,050 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,050 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,050 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/a80c1bbbdf4887e2b3f39a590baf773c 2017-12-06 22:44:52,051 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1446 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits and itself. 2017-12-06 22:44:52,051 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f1 2017-12-06 22:44:52,051 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1447 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 and itself. 2017-12-06 22:44:52,052 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,052 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,053 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2/fc87dae54f244209aceeb07080edeb3d from archive 2017-12-06 22:44:52,054 INFO [IPC Server handler 6 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:55766 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,054 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,055 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,055 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/f2 2017-12-06 22:44:52,055 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1450 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits and itself. 2017-12-06 22:44:52,056 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,057 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,057 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,057 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,057 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,057 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/recovered.edits 2017-12-06 22:44:52,057 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,058 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,058 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 and itself. 2017-12-06 22:44:52,059 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,059 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,060 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,061 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,060 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(435): There is no file under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,060 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2/07e4586f8471492a8080b72d6198f9b7 from archive 2017-12-06 22:44:52,062 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398/recovered.edits 2017-12-06 22:44:52,062 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,062 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,064 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2/b5d54561368f447f9ced269fa85f2564 from archive 2017-12-06 22:44:52,064 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/645e3955239c612f4345ca54c742f398 2017-12-06 22:44:52,064 INFO [IPC Server handler 4 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:55766 2017-12-06 22:44:52,065 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,065 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,065 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,065 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,065 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,065 INFO [IPC Server handler 1 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741863_1039 127.0.0.1:55766 2017-12-06 22:44:52,066 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,066 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,066 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,066 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,066 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1448 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 and itself. 2017-12-06 22:44:52,067 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686/f2 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,067 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/f2 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/cc9fa787e9e90dda082801b829751686 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1449 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 and itself. 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,072 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,074 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,075 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79/recovered.edits 2017-12-06 22:44:52,075 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,075 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,076 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/5707781f5e2aace24e68cf1e95aa3a79 2017-12-06 22:44:52,077 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1450 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits and itself. 2017-12-06 22:44:52,077 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(413): CleanerTask 1443 starts cleaning dirs and files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits and itself. 2017-12-06 22:44:52,077 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7/recovered.edits 2017-12-06 22:44:52,077 DEBUG [asf911:39318.masterManager-HFileCleaner.large.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2/eb2cf683870f40d0bf846b47add2f5f3 from archive 2017-12-06 22:44:52,082 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,082 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,083 INFO [IPC Server handler 2 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:55766 2017-12-06 22:44:52,083 DEBUG [ForkJoinPool-1-worker-7] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits/f70e6c2f25c41dd4451000859071a3f7 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,084 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(430): There is no subdir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,085 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,085 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2/52f27716b1fd4d15997054d0963e163b from archive 2017-12-06 22:44:52,085 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,085 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/f2 2017-12-06 22:44:52,085 DEBUG [ForkJoinPool-1-worker-14] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionNoPreserveSplits 2017-12-06 22:44:52,086 INFO [IPC Server handler 5 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:55766 2017-12-06 22:44:52,086 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,086 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,086 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,086 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,087 DEBUG [ForkJoinPool-1-worker-11] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f2 2017-12-06 22:44:52,087 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1/9c86272321f04a12aea8e363083081ad from archive 2017-12-06 22:44:52,088 INFO [IPC Server handler 9 on 51925] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:55766 2017-12-06 22:44:52,088 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,088 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,088 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,088 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,088 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,089 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/f1 2017-12-06 22:44:52,089 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,089 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,090 DEBUG [asf911:39318.masterManager-HFileCleaner.small.0-1512599927646] cleaner.HFileCleaner(246): Removing: hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits/8.seqid from archive 2017-12-06 22:44:52,090 DEBUG [ForkJoinPool-1-worker-4] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234/recovered.edits 2017-12-06 22:44:52,090 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,090 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting files under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits/c045ee6cbe9d5cfbf9869e49fcdf3234 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:52,092 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:52,093 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098/recovered.edits 2017-12-06 22:44:52,093 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,093 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,094 DEBUG [ForkJoinPool-1-worker-25] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testRecoveryAndDoubleExecutionPreserveSplits 2017-12-06 22:44:52,094 DEBUG [ForkJoinPool-1-worker-18] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits/fa1e4268b5393156c1b54ef4624e3098 2017-12-06 22:44:52,094 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting subdirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:52,094 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(484): Start deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:52,096 DEBUG [ForkJoinPool-1-worker-21] cleaner.CleanerChore$CleanerTask(493): Finish deleting dir under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default/testSimpleTruncateNoPreserveSplits 2017-12-06 22:44:52,096 DEBUG [ForkJoinPool-1-worker-28] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data/default with reasons: undeletable, please check. 2017-12-06 22:44:52,096 DEBUG [ForkJoinPool-1-worker-3] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive/data with reasons: undeletable, please check. 2017-12-06 22:44:52,096 DEBUG [ForkJoinPool-1-worker-6] cleaner.CleanerChore$CleanerTask(495): Couldn't delete subdirs completely under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive with reasons: undeletable, please check. 2017-12-06 22:44:52,096 WARN [asf911.gq1.ygridcore.net,39318,1512599924553_Chore_1] cleaner.CleanerChore(225): Failed to fully clean old files/dirs under hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/archive. 2017-12-06 22:44:52,861 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x2ddabd09 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:44:52,909 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:52,930 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 32778ms 2017-12-06 22:44:52,930 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43701ms 2017-12-06 22:44:53,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:44:53,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 298536ms 2017-12-06 22:44:53,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197076ms 2017-12-06 22:44:54,018 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@efde75f] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:55766 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741893_1069, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022, blk_1073741847_1023, blk_1073741848_1024, blk_1073741851_1027, blk_1073741852_1028, blk_1073741858_1034, blk_1073741859_1035, blk_1073741860_1036, blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741879_1055, blk_1073741880_1056, blk_1073741886_1062, blk_1073741887_1063] 2017-12-06 22:44:54,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 36281ms 2017-12-06 22:44:54,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129589ms 2017-12-06 22:44:55,703 INFO [ReadOnlyZKClient] zookeeper.ReadOnlyZKClient(306): 0x1abebef3 no activities for 60000 ms, close active connection. Will reconnect next time when there are new requests. 2017-12-06 22:44:55,911 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 153163ms 2017-12-06 22:44:55,911 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33695ms 2017-12-06 22:44:56,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 296933ms 2017-12-06 22:44:56,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16933ms 2017-12-06 22:44:57,903 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 285637ms 2017-12-06 22:44:57,903 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207592ms 2017-12-06 22:44:57,910 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:44:58,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 132595ms 2017-12-06 22:44:58,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35297ms 2017-12-06 22:44:59,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 167300ms 2017-12-06 22:44:59,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140186ms 2017-12-06 22:45:00,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 208221ms 2017-12-06 22:45:00,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76982ms 2017-12-06 22:45:01,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 25941ms 2017-12-06 22:45:01,889 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231916ms 2017-12-06 22:45:02,910 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:02,949 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 65487ms 2017-12-06 22:45:02,949 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173469ms 2017-12-06 22:45:03,977 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. because info has an old edit so flush to free WALs after random delay 31597ms 2017-12-06 22:45:03,977 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 898ms 2017-12-06 22:45:04,322 INFO [MemStoreFlusher.0] regionserver.HRegion(2506): Flushing 1/1 column families, memstore=78 B 2017-12-06 22:45:04,345 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741927_1103{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 4898 2017-12-06 22:45:04,747 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=6, memsize=78, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/.tmp/info/c631cb6694494ce29dd8e83925a53be2 2017-12-06 22:45:04,756 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/.tmp/info/c631cb6694494ce29dd8e83925a53be2 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/info/c631cb6694494ce29dd8e83925a53be2 2017-12-06 22:45:04,763 INFO [MemStoreFlusher.0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/info/c631cb6694494ce29dd8e83925a53be2, entries=2, sequenceid=6, filesize=4.8 K 2017-12-06 22:45:04,765 INFO [MemStoreFlusher.0] regionserver.HRegion(2702): Finished memstore flush of ~78 B/78, currentsize=0 B/0 for region hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. in 443ms, sequenceid=6, compaction requested=false 2017-12-06 22:45:04,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142331ms 2017-12-06 22:45:05,986 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188741ms 2017-12-06 22:45:06,927 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139222ms 2017-12-06 22:45:07,898 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252781ms 2017-12-06 22:45:07,911 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:08,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17466ms 2017-12-06 22:45:09,974 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248521ms 2017-12-06 22:45:10,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153076ms 2017-12-06 22:45:11,907 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254126ms 2017-12-06 22:45:12,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23200ms 2017-12-06 22:45:12,912 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:45:13,916 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252672ms 2017-12-06 22:45:14,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299795ms 2017-12-06 22:45:15,950 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5305ms 2017-12-06 22:45:16,928 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128410ms 2017-12-06 22:45:17,912 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:17,939 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149652ms 2017-12-06 22:45:18,957 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159663ms 2017-12-06 22:45:19,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66644ms 2017-12-06 22:45:20,982 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152519ms 2017-12-06 22:45:21,952 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247690ms 2017-12-06 22:45:22,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117472ms 2017-12-06 22:45:22,913 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:23,940 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140669ms 2017-12-06 22:45:24,915 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281616ms 2017-12-06 22:45:25,913 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54528ms 2017-12-06 22:45:26,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229440ms 2017-12-06 22:45:27,913 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:27,944 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285387ms 2017-12-06 22:45:28,926 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73893ms 2017-12-06 22:45:29,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182101ms 2017-12-06 22:45:30,897 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279321ms 2017-12-06 22:45:31,969 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77069ms 2017-12-06 22:45:32,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185654ms 2017-12-06 22:45:32,914 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:33,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39318] master.MasterRpcServices(1124): Checking to see if procedure is done pid=104 2017-12-06 22:45:33,931 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184065ms 2017-12-06 22:45:34,949 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273136ms 2017-12-06 22:45:35,887 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1763): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224847ms 2017-12-06 22:45:35,959 INFO [main] hbase.ResourceChecker(172): after: master.procedure.TestTruncateTableProcedure#testSimpleTruncatePreserveSplits Thread=223 (was 210) - Thread LEAK? -, OpenFileDescriptor=747 (was 747), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=255 (was 249) - ProcessCount LEAK? -, AvailableMemoryMB=6511 (was 12461) 2017-12-06 22:45:35,960 INFO [main] hbase.HBaseTestingUtility(1078): Shutting down minicluster 2017-12-06 22:45:35,960 INFO [main] client.ConnectionImplementation(1757): Closing master protocol: MasterService 2017-12-06 22:45:35,960 INFO [main] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x1abebef3 to localhost:49877 2017-12-06 22:45:35,961 DEBUG [main] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:35,961 DEBUG [main] util.JVMClusterUtil(237): Shutting down HBase Cluster 2017-12-06 22:45:35,961 INFO [main] master.ServerManager(952): Cluster shutdown requested of master=asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:45:35,962 INFO [main] regionserver.HRegionServer(2165): ***** STOPPING region server 'asf911.gq1.ygridcore.net,39318,1512599924553' ***** 2017-12-06 22:45:35,962 DEBUG [RS-EventLoopGroup-1-3] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:46317. Number of active connections: 0 2017-12-06 22:45:35,962 INFO [main] regionserver.HRegionServer(2179): STOPPED: Cluster shutdown requested of master=asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:45:35,963 DEBUG [M:0;asf911:39318] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3776ef0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=asf911.gq1.ygridcore.net/67.195.81.155:0 2017-12-06 22:45:35,964 INFO [M:0;asf911:39318] regionserver.HRegionServer(1082): stopping server asf911.gq1.ygridcore.net,39318,1512599924553 2017-12-06 22:45:35,964 DEBUG [M:0;asf911:39318] zookeeper.MetaTableLocator(626): Stopping MetaTableLocator 2017-12-06 22:45:35,965 INFO [M:0;asf911:39318] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x3fa528d8 to localhost:49877 2017-12-06 22:45:35,965 DEBUG [M:0;asf911:39318] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:35,965 INFO [M:0;asf911:39318] regionserver.HRegionServer(1110): stopping server asf911.gq1.ygridcore.net,39318,1512599924553; all regions closed. 2017-12-06 22:45:35,965 DEBUG [M:0;asf911:39318] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:35,965 DEBUG [RS-EventLoopGroup-3-17] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: /67.195.81.155:48294. Number of active connections: -1 2017-12-06 22:45:35,966 INFO [M:0;asf911:39318] hbase.ChoreService(326): Chore service for: asf911.gq1.ygridcore.net,39318,1512599924553 had [[ScheduledChore: Name: asf911.gq1.ygridcore.net,39318,1512599924553-MobCompactionChore Period: 604800 Unit: SECONDS], [ScheduledChore: Name: HFileCleaner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: asf911.gq1.ygridcore.net,39318,1512599924553-ClusterStatusChore Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: ReplicationZKNodeCleanerChore Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: ReplicationMetaCleaner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: asf911.gq1.ygridcore.net,39318,1512599924553-BalancerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: LogsCleaner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CatalogJanitor-asf911:39318 Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: asf911.gq1.ygridcore.net,39318,1512599924553-RegionNormalizerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: asf911.gq1.ygridcore.net,39318,1512599924553-ExpiredMobFileCleanerChore Period: 86400 Unit: SECONDS]] on shutdown 2017-12-06 22:45:35,967 INFO [M:0;asf911:39318] master.MasterMobCompactionThread(175): Waiting for Mob Compaction Thread to finish... 2017-12-06 22:45:35,967 INFO [M:0;asf911:39318] master.MasterMobCompactionThread(175): Waiting for Region Server Mob Compaction Thread to finish... 2017-12-06 22:45:35,967 INFO [M:0;asf911:39318] master.ServerManager(529): Waiting on regionserver(s) to go down asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:35,977 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2017-12-06 22:45:35,977 INFO [main] regionserver.HRegionServer(2165): ***** STOPPING region server 'asf911.gq1.ygridcore.net,43202,1512599926033' ***** 2017-12-06 22:45:35,977 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2017-12-06 22:45:35,977 INFO [main] regionserver.HRegionServer(2179): STOPPED: Shutdown requested 2017-12-06 22:45:35,977 DEBUG [main-EventThread] zookeeper.ZKUtil(344): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-12-06 22:45:35,977 INFO [RS:0;asf911:43202] regionserver.SplitLogWorker(160): Sending interrupt to stop the worker thread 2017-12-06 22:45:35,978 INFO [RS:0;asf911:43202] regionserver.HeapMemoryManager(221): Stopping HeapMemoryTuner chore. 2017-12-06 22:45:35,978 DEBUG [main-EventThread] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-12-06 22:45:35,978 INFO [SplitLogWorker-asf911:43202] regionserver.SplitLogWorker(142): SplitLogWorker interrupted. Exiting. 2017-12-06 22:45:35,978 INFO [SplitLogWorker-asf911:43202] regionserver.SplitLogWorker(151): SplitLogWorker asf911.gq1.ygridcore.net,43202,1512599926033 exiting 2017-12-06 22:45:35,978 INFO [RS:0;asf911:43202] flush.RegionServerFlushTableProcedureManager(115): Stopping region server flush procedure manager gracefully. 2017-12-06 22:45:35,978 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(273): MemStoreFlusher.0 exiting 2017-12-06 22:45:35,978 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(273): MemStoreFlusher.1 exiting 2017-12-06 22:45:35,978 INFO [RS:0;asf911:43202] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.: disabling compactions & flushes 2017-12-06 22:45:35,979 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1082): stopping server asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:35,979 DEBUG [RS:0;asf911:43202] zookeeper.MetaTableLocator(626): Stopping MetaTableLocator 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.: disabling compactions & flushes 2017-12-06 22:45:35,980 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:45:35,980 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=666 B 2017-12-06 22:45:35,981 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.store: f1 2017-12-06 22:45:35,981 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:35,979 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:45:35,983 INFO [StoreCloserThread-hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d.-1] regionserver.HStore(925): Closed info 2017-12-06 22:45:35,983 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.store: f2 2017-12-06 22:45:35,983 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:35,979 INFO [RS:0;asf911:43202] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x5adb9ac4 to localhost:49877 2017-12-06 22:45:35,984 DEBUG [RS:0;asf911:43202] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:35,983 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.: disabling compactions & flushes 2017-12-06 22:45:35,984 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:45:35,985 INFO [RS:0;asf911:43202] regionserver.CompactSplit(395): Waiting for Split Thread to finish... 2017-12-06 22:45:35,985 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:45:35,985 INFO [StoreCloserThread-testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:45:35,985 INFO [RS:0;asf911:43202] regionserver.CompactSplit(395): Waiting for Large Compaction Thread to finish... 2017-12-06 22:45:35,985 INFO [RS:0;asf911:43202] regionserver.CompactSplit(395): Waiting for Small Compaction Thread to finish... 2017-12-06 22:45:35,987 INFO [asf911.gq1.ygridcore.net,39318,1512599924553_splitLogManager__Chore_1] hbase.ScheduledChore(181): Chore: SplitLogManager Timeout Monitor was stopped 2017-12-06 22:45:35,987 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1389): Waiting on 7 regions to close 2017-12-06 22:45:35,987 DEBUG [RS_CLOSE_META-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of hbase:meta,,1.1588230740 2017-12-06 22:45:35,988 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1393): Online Regions={98664e5c7a903927b03ac89fe21a8d2d=hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d., 84d67cd4b84b3eb223bc0ffdc96e8e5e=testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e., 1c6cd8294a789f4998b71741869e1aa7=testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7., e9f2e3d66bf51aa5d73745df63badf9a=testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a., 1588230740=hbase:meta,,1.1588230740, 5bd5770f4cb5fda71c84441d6be2c0e7=testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7., c24958fa636e29e21028e350d32623fb=testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.} 2017-12-06 22:45:35,988 DEBUG [RS_CLOSE_META-asf911:43202-0] regionserver.HRegion(1471): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2017-12-06 22:45:35,989 DEBUG [RS_CLOSE_META-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region hbase:meta,,1.1588230740 2017-12-06 22:45:35,990 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HRegion(2506): Flushing 5/5 column families, memstore=58.44 KB 2017-12-06 22:45:36,003 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/namespace/98664e5c7a903927b03ac89fe21a8d2d/recovered.edits/9.seqid, newSeqId=9, maxSeqId=2 2017-12-06 22:45:36,003 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testRecoveryAndDoubleExecutionPreserveSplits/84d67cd4b84b3eb223bc0ffdc96e8e5e/recovered.edits/4.seqid, newSeqId=4, maxSeqId=2 2017-12-06 22:45:36,006 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:45:36,006 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:45:36,013 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512599988575 table_name { namespace: "default" qualifier: "testRecoveryAndDoubleExecutionPreserveSplits" } start_key: "a" end_key: "b" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,013 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testRecoveryAndDoubleExecutionPreserveSplits,a,1512599988575.84d67cd4b84b3eb223bc0ffdc96e8e5e. 2017-12-06 22:45:36,013 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:45:36,013 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.: disabling compactions & flushes 2017-12-06 22:45:36,013 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:45:36,013 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=666 B 2017-12-06 22:45:36,016 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.store: f1 2017-12-06 22:45:36,016 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,016 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.store: f2 2017-12-06 22:45:36,016 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,018 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512599931065 table_name { namespace: "hbase" qualifier: "namespace" } start_key: "" end_key: "" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,018 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed hbase:namespace,,1512599931065.98664e5c7a903927b03ac89fe21a8d2d. 2017-12-06 22:45:36,018 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:45:36,018 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.: disabling compactions & flushes 2017-12-06 22:45:36,018 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:45:36,018 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=3.40 KB 2017-12-06 22:45:36,021 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.store: f1 2017-12-06 22:45:36,021 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,021 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.store: f2 2017-12-06 22:45:36,021 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,023 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741928_1104{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:45:36,025 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741929_1105{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 19096 2017-12-06 22:45:36,038 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741930_1106{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5260 2017-12-06 22:45:36,041 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741931_1107{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 6714 2017-12-06 22:45:36,424 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/.tmp/f1/5c285ebffd414d7e8f472ff1646d5372 2017-12-06 22:45:36,426 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=183, memsize=54.6 K, hasBloomFilter=false, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/.tmp/info/4fed1741344c40968586f7f989f8d3b5 2017-12-06 22:45:36,435 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.StoreFileReader(497): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4fed1741344c40968586f7f989f8d3b5 2017-12-06 22:45:36,438 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/.tmp/f1/b134ab11661645fdbbf1319d84972f1b 2017-12-06 22:45:36,446 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/.tmp/f1/832865e831074177ae25d0a1c12b2ea9 2017-12-06 22:45:36,453 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741932_1108{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5262 2017-12-06 22:45:36,454 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741933_1109{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 0 2017-12-06 22:45:36,459 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=183, memsize=3.8 K, hasBloomFilter=false, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/.tmp/table/40bd467f279749708cc901a629d7ba77 2017-12-06 22:45:36,472 DEBUG [RS_CLOSE_META-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/.tmp/info/4fed1741344c40968586f7f989f8d3b5 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/info/4fed1741344c40968586f7f989f8d3b5 2017-12-06 22:45:36,474 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741934_1110{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5260 2017-12-06 22:45:36,480 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741935_1111{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 6714 2017-12-06 22:45:36,480 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.StoreFileReader(497): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4fed1741344c40968586f7f989f8d3b5 2017-12-06 22:45:36,480 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/info/4fed1741344c40968586f7f989f8d3b5, entries=103, sequenceid=183, filesize=18.6 K 2017-12-06 22:45:36,482 DEBUG [RS_CLOSE_META-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/.tmp/table/40bd467f279749708cc901a629d7ba77 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/table/40bd467f279749708cc901a629d7ba77 2017-12-06 22:45:36,489 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/table/40bd467f279749708cc901a629d7ba77, entries=20, sequenceid=183, filesize=5.6 K 2017-12-06 22:45:36,493 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~58.44 KB/59847, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 504ms, sequenceid=183, compaction requested=false 2017-12-06 22:45:36,494 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed info 2017-12-06 22:45:36,494 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_barrier 2017-12-06 22:45:36,494 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_meta 2017-12-06 22:45:36,495 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed rep_position 2017-12-06 22:45:36,496 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(925): Closed table 2017-12-06 22:45:36,501 DEBUG [RS_CLOSE_META-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/hbase/meta/1588230740/recovered.edits/186.seqid, newSeqId=186, maxSeqId=3 2017-12-06 22:45:36,502 DEBUG [RS_CLOSE_META-asf911:43202-0] coprocessor.CoprocessorHost(289): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2017-12-06 22:45:36,504 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HRegion(1623): Closed hbase:meta,,1.1588230740 2017-12-06 22:45:36,505 INFO [RS_CLOSE_META-asf911:43202-0] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1 table_name { namespace: "hbase" qualifier: "meta" } start_key: "" end_key: "" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,505 DEBUG [RS_CLOSE_META-asf911:43202-0] handler.CloseRegionHandler(126): Closed hbase:meta,,1.1588230740 2017-12-06 22:45:36,855 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/.tmp/f2/600d0eac8eec4405a165d15f33eecc41 2017-12-06 22:45:36,862 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/.tmp/f1/5c285ebffd414d7e8f472ff1646d5372 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f1/5c285ebffd414d7e8f472ff1646d5372 2017-12-06 22:45:36,869 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f1/5c285ebffd414d7e8f472ff1646d5372, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:45:36,870 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/.tmp/f2/600d0eac8eec4405a165d15f33eecc41 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f2/600d0eac8eec4405a165d15f33eecc41 2017-12-06 22:45:36,874 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/.tmp/f2/04e433dcbef54484bd79cc7e674ba77d 2017-12-06 22:45:36,879 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/f2/600d0eac8eec4405a165d15f33eecc41, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:45:36,881 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~666 B/666, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. in 901ms, sequenceid=5, compaction requested=false 2017-12-06 22:45:36,881 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=1.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/.tmp/f2/9286924eabec437ba8f7fb93eaec9c08 2017-12-06 22:45:36,883 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:45:36,885 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:45:36,887 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/.tmp/f1/b134ab11661645fdbbf1319d84972f1b as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f1/b134ab11661645fdbbf1319d84972f1b 2017-12-06 22:45:36,888 INFO [asf911.gq1.ygridcore.net,43202,1512599926033_Chore_1] hbase.ScheduledChore(181): Chore: MemstoreFlusherChore was stopped 2017-12-06 22:45:36,891 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/1c6cd8294a789f4998b71741869e1aa7/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:45:36,893 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:45:36,894 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512600162483 table_name { namespace: "default" qualifier: "testSimpleTruncatePreserveSplits" } start_key: "b" end_key: "c" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,894 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,b,1512600162483.1c6cd8294a789f4998b71741869e1aa7. 2017-12-06 22:45:36,894 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(93): Processing close of testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:45:36,894 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1471): Closing testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.: disabling compactions & flushes 2017-12-06 22:45:36,894 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1510): Updates disabled for region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:45:36,894 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2506): Flushing 2/2 column families, memstore=1.83 KB 2017-12-06 22:45:36,894 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.store: f1 2017-12-06 22:45:36,895 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,895 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactingMemStore(197): FLUSHING TO DISK: region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.store: f2 2017-12-06 22:45:36,895 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.CompactionPipeline(129): Swapping pipeline suffix. Just before the swap the number of segments in pipeline is:1, and the new segment is:null 2017-12-06 22:45:36,897 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/.tmp/f1/832865e831074177ae25d0a1c12b2ea9 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f1/832865e831074177ae25d0a1c12b2ea9 2017-12-06 22:45:36,900 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f1/b134ab11661645fdbbf1319d84972f1b, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:45:36,901 DEBUG [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/.tmp/f2/04e433dcbef54484bd79cc7e674ba77d as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f2/04e433dcbef54484bd79cc7e674ba77d 2017-12-06 22:45:36,907 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f1/832865e831074177ae25d0a1c12b2ea9, entries=26, sequenceid=5, filesize=6.6 K 2017-12-06 22:45:36,907 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741936_1112{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 5896 2017-12-06 22:45:36,908 DEBUG [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/.tmp/f2/9286924eabec437ba8f7fb93eaec9c08 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f2/9286924eabec437ba8f7fb93eaec9c08 2017-12-06 22:45:36,910 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/f2/04e433dcbef54484bd79cc7e674ba77d, entries=5, sequenceid=5, filesize=5.1 K 2017-12-06 22:45:36,911 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(2702): Finished memstore flush of ~666 B/666, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. in 898ms, sequenceid=5, compaction requested=false 2017-12-06 22:45:36,912 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:45:36,913 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:45:36,916 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/f2/9286924eabec437ba8f7fb93eaec9c08, entries=26, sequenceid=5, filesize=6.6 K 2017-12-06 22:45:36,918 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(2702): Finished memstore flush of ~3.40 KB/3484, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. in 900ms, sequenceid=5, compaction requested=false 2017-12-06 22:45:36,919 DEBUG [RS_CLOSE_REGION-asf911:43202-1] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/e9f2e3d66bf51aa5d73745df63badf9a/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:45:36,923 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:45:36,923 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:45:36,924 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:45:36,924 INFO [RS_CLOSE_REGION-asf911:43202-1] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512600162483 table_name { namespace: "default" qualifier: "testSimpleTruncatePreserveSplits" } start_key: "a" end_key: "b" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,924 DEBUG [RS_CLOSE_REGION-asf911:43202-1] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,a,1512600162483.e9f2e3d66bf51aa5d73745df63badf9a. 2017-12-06 22:45:36,930 DEBUG [RS_CLOSE_REGION-asf911:43202-2] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/5bd5770f4cb5fda71c84441d6be2c0e7/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:45:36,931 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:45:36,932 INFO [RS_CLOSE_REGION-asf911:43202-2] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512600162483 table_name { namespace: "default" qualifier: "testSimpleTruncatePreserveSplits" } start_key: "" end_key: "a" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:36,932 DEBUG [RS_CLOSE_REGION-asf911:43202-2] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,,1512600162483.5bd5770f4cb5fda71c84441d6be2c0e7. 2017-12-06 22:45:36,954 INFO [regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0.leaseChecker] regionserver.Leases(147): regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0.leaseChecker closing leases 2017-12-06 22:45:36,955 INFO [regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0.leaseChecker] regionserver.Leases(150): regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0.leaseChecker closed leases 2017-12-06 22:45:36,984 INFO [M:0;asf911:39318] master.ServerManager(529): Waiting on regionserver(s) to go down asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:36,989 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1389): Waiting on 1 regions to close 2017-12-06 22:45:36,989 DEBUG [RS:0;asf911:43202] regionserver.HRegionServer(1393): Online Regions={c24958fa636e29e21028e350d32623fb=testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.} 2017-12-06 22:45:37,309 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=936, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/.tmp/f1/4832590148b24f8cbdbdb34d84b7f072 2017-12-06 22:45:37,325 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741937_1113{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 5896 2017-12-06 22:45:37,727 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=5, memsize=936, hasBloomFilter=true, into tmp file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/.tmp/f2/518af14f3d654246b322984bd91ad053 2017-12-06 22:45:37,736 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/.tmp/f1/4832590148b24f8cbdbdb34d84b7f072 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f1/4832590148b24f8cbdbdb34d84b7f072 2017-12-06 22:45:37,745 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f1/4832590148b24f8cbdbdb34d84b7f072, entries=14, sequenceid=5, filesize=5.8 K 2017-12-06 22:45:37,747 DEBUG [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionFileSystem(464): Committing store file hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/.tmp/f2/518af14f3d654246b322984bd91ad053 as hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f2/518af14f3d654246b322984bd91ad053 2017-12-06 22:45:37,757 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HStore(1023): Added hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/f2/518af14f3d654246b322984bd91ad053, entries=14, sequenceid=5, filesize=5.8 K 2017-12-06 22:45:37,759 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(2702): Finished memstore flush of ~1.83 KB/1872, currentsize=0 B/0 for region testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. in 865ms, sequenceid=5, compaction requested=false 2017-12-06 22:45:37,760 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.-1] regionserver.HStore(925): Closed f1 2017-12-06 22:45:37,761 INFO [StoreCloserThread-testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb.-1] regionserver.HStore(925): Closed f2 2017-12-06 22:45:37,768 DEBUG [RS_CLOSE_REGION-asf911:43202-0] wal.WALSplitter(660): Wrote file=hdfs://localhost:51925/user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/data/default/testSimpleTruncatePreserveSplits/c24958fa636e29e21028e350d32623fb/recovered.edits/8.seqid, newSeqId=8, maxSeqId=2 2017-12-06 22:45:37,770 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegion(1623): Closed testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:45:37,771 INFO [RS_CLOSE_REGION-asf911:43202-0] regionserver.HRegionServer(2322): TRANSITION NOT REPORTED server { host_name: "asf911.gq1.ygridcore.net" port: 43202 start_code: 1512599926033 } transition { transition_code: CLOSED region_info { region_id: 1512600162483 table_name { namespace: "default" qualifier: "testSimpleTruncatePreserveSplits" } start_key: "c" end_key: "" offline: false split: false replica_id: 0 } } 2017-12-06 22:45:37,771 DEBUG [RS_CLOSE_REGION-asf911:43202-0] handler.CloseRegionHandler(126): Closed testSimpleTruncatePreserveSplits,c,1512600162483.c24958fa636e29e21028e350d32623fb. 2017-12-06 22:45:37,790 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1110): stopping server asf911.gq1.ygridcore.net,43202,1512599926033; all regions closed. 2017-12-06 22:45:37,790 DEBUG [RS:0;asf911:43202] wal.FSHLog(433): Closing WAL writer in /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:37,793 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741831_1007{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2bd0db94-5c0d-4200-b9c6-157bd55a2fae:NORMAL:127.0.0.1:55766|RBW]]} size 69239 2017-12-06 22:45:37,915 WARN [ProcExecTimeout] assignment.AssignmentManager(1147): TODO Handle stuck in transition: rit=OFFLINE, location=asf911.gq1.ygridcore.net,43202,1512599926033, table=testRecoveryAndDoubleExecutionPreserveSplits, region=6190bf675a14a1eedcf58368d0992978 2017-12-06 22:45:37,991 INFO [M:0;asf911:39318] master.ServerManager(529): Waiting on regionserver(s) to go down asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:38,197 DEBUG [RS:0;asf911:43202] wal.AbstractFSWAL(845): Moved 1 WAL file(s) to /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:45:38,197 INFO [RS:0;asf911:43202] wal.AbstractFSWAL(848): Closed WAL: FSHLog asf911.gq1.ygridcore.net%2C43202%2C1512599926033.meta:.meta(num 1512599930347) 2017-12-06 22:45:38,197 DEBUG [RS:0;asf911:43202] wal.FSHLog(433): Closing WAL writer in /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/WALs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:38,201 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741830_1006{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 34519 2017-12-06 22:45:38,604 DEBUG [RS:0;asf911:43202] wal.AbstractFSWAL(845): Moved 1 WAL file(s) to /user/jenkins/test-data/8f4a7bec-3edc-4c3b-a0ed-a2d671459cc5/oldWALs 2017-12-06 22:45:38,605 INFO [RS:0;asf911:43202] wal.AbstractFSWAL(848): Closed WAL: FSHLog asf911.gq1.ygridcore.net%2C43202%2C1512599926033:(num 1512599929989) 2017-12-06 22:45:38,605 DEBUG [RS:0;asf911:43202] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:38,605 INFO [RS:0;asf911:43202] regionserver.Leases(147): RS:0;asf911:43202 closing leases 2017-12-06 22:45:38,605 INFO [RS:0;asf911:43202] regionserver.Leases(150): RS:0;asf911:43202 closed leases 2017-12-06 22:45:38,605 DEBUG [RS-EventLoopGroup-1-2] ipc.NettyRpcServerRequestDecoder(71): Disconnecting client: asf911.gq1.ygridcore.net/67.195.81.155:54342. Number of active connections: -1 2017-12-06 22:45:38,605 INFO [RS:0;asf911:43202] hbase.ChoreService(326): Chore service for: asf911.gq1.ygridcore.net,43202,1512599926033 had [[ScheduledChore: Name: MovedRegionsCleaner for region asf911.gq1.ygridcore.net,43202,1512599926033 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2017-12-06 22:45:38,607 INFO [regionserver/asf911.gq1.ygridcore.net/67.195.81.155:0.logRoller] regionserver.LogRoller(199): LogRoller exiting. 2017-12-06 22:45:38,609 INFO [RS:0;asf911:43202] ipc.NettyRpcServer(142): Stopping server on 0 2017-12-06 22:45:38,633 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:38,633 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf911.gq1.ygridcore.net,43202,1512599926033 2017-12-06 22:45:38,633 INFO [main-EventThread] master.RegionServerTracker(122): RegionServer ephemeral node deleted, processing expiration [asf911.gq1.ygridcore.net,43202,1512599926033] 2017-12-06 22:45:38,633 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): regionserver:43202-0x1602dfb2ba70001, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2017-12-06 22:45:38,634 INFO [main-EventThread] master.ServerManager(589): Cluster shutdown set; asf911.gq1.ygridcore.net,43202,1512599926033 expired; onlineServers=0 2017-12-06 22:45:38,634 DEBUG [M:0;asf911:39318] master.HMaster(1183): Stopping service threads 2017-12-06 22:45:38,634 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2017-12-06 22:45:38,644 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1156): stopping server asf911.gq1.ygridcore.net,43202,1512599926033; zookeeper connection closed. 2017-12-06 22:45:38,645 INFO [RS:0;asf911:43202] regionserver.HRegionServer(1158): RS:0;asf911:43202 exiting 2017-12-06 22:45:38,645 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ff141a7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(200): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ff141a7 2017-12-06 22:45:38,647 INFO [main] util.JVMClusterUtil(322): Shutdown of 1 master(s) and 1 regionserver(s) complete 2017-12-06 22:45:38,651 DEBUG [main-EventThread] zookeeper.ZKWatcher(460): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2017-12-06 22:45:38,651 INFO [M:0;asf911:39318] assignment.AssignmentManager(232): Stopping assignment manager 2017-12-06 22:45:38,651 INFO [M:0;asf911:39318] zookeeper.ReadOnlyZKClient(333): Close zookeeper connection 0x2ddabd09 to localhost:49877 2017-12-06 22:45:38,651 DEBUG [M:0;asf911:39318] ipc.AbstractRpcClient(483): Stopping rpc client 2017-12-06 22:45:38,651 DEBUG [main-EventThread] zookeeper.ZKUtil(344): master:39318-0x1602dfb2ba70000, quorum=localhost:49877, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-12-06 22:45:38,652 INFO [M:0;asf911:39318] procedure2.RemoteProcedureDispatcher(116): Stopping procedure remote dispatcher 2017-12-06 22:45:38,652 INFO [M:0;asf911:39318] procedure2.ProcedureExecutor(571): Stopping 2017-12-06 22:45:38,653 INFO [M:0;asf911:39318] wal.WALProcedureStore(287): Stopping the WAL Procedure Store, isAbort=false 2017-12-06 22:45:38,653 DEBUG [ProcExecWrkr-1] procedure2.ProcedureExecutor$WorkerThread(1750): Worker terminated. 2017-12-06 22:45:38,657 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55766 is added to blk_1073741908_1084{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-60fd6215-0471-4c98-8e9e-ca420144bc62:NORMAL:127.0.0.1:55766|RBW]]} size 214 2017-12-06 22:45:38,658 INFO [M:0;asf911:39318] hbase.ChoreService(326): Chore service for: asf911.gq1.ygridcore.net,39318,1512599924553_splitLogManager_ had [] on shutdown 2017-12-06 22:45:38,659 INFO [M:0;asf911:39318] flush.MasterFlushTableProcedureManager(79): stop: server shutting down. 2017-12-06 22:45:38,659 INFO [M:0;asf911:39318] ipc.NettyRpcServer(142): Stopping server on 0 2017-12-06 22:45:38,668 DEBUG [M:0;asf911:39318] zookeeper.RecoverableZooKeeper(175): Node /hbase/rs/asf911.gq1.ygridcore.net,39318,1512599924553 already deleted, retry=false 2017-12-06 22:45:38,676 INFO [M:0;asf911:39318] regionserver.HRegionServer(1156): stopping server asf911.gq1.ygridcore.net,39318,1512599924553; zookeeper connection closed. 2017-12-06 22:45:38,676 INFO [M:0;asf911:39318] regionserver.HRegionServer(1158): M:0;asf911:39318 exiting 2017-12-06 22:45:38,678 WARN [main] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2017-12-06 22:45:38,699 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2017-12-06 22:45:38,804 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data1/, [DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:51925] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2017-12-06 22:45:38,805 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data1/, [DISK]file:/home/jenkins/jenkins-slave/workspace/HBase-Flaky-Tests/hbase-server/target/test-data/3a8fa0d4-326a-40c0-a743-e2c923105306/cluster_1b951d9c-64af-419e-b95a-868f1a3eb5bb/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:51925] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-109774452-67.195.81.155-1512599919954 (Datanode Uuid f216d282-741f-4d5d-a8a5-ae3ac72cf164) service to localhost/127.0.0.1:51925 2017-12-06 22:45:38,806 INFO [Time-limited test] procedure.MasterProcedureTestingUtility(410): Restart 5 exec state=pid=73, state=RUNNABLE:TRUNCATE_TABLE_ADD_TO_META; TruncateTableProcedure (table=testRecoveryAndDoubleExecutionPreserveSplits preserveSplits=true) 2017-12-06 22:45:38,806 INFO [Time-limited test] procedure2.ProcedureTestingUtility(87): RESTART - Stop 2017-12-06 22:45:38,835 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2017-12-06 22:45:38,942 ERROR [main] server.ZooKeeperServer(472): ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 2017-12-06 22:45:38,946 INFO [main] zookeeper.MiniZooKeeperCluster(320): Shutdown MiniZK cluster with all ZK servers 2017-12-06 22:45:38,967 INFO [main] hbase.HBaseTestingUtility(1089): Minicluster is down 2017-12-06 22:45:38,999 INFO [Thread-3] regionserver.ShutdownHook$ShutdownHookThread(111): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@5c671d7f 2017-12-06 22:45:39,000 INFO [Thread-3] regionserver.ShutdownHook$ShutdownHookThread(120): Starting fs shutdown hook thread. 2017-12-06 22:45:39,001 INFO [Thread-3] regionserver.ShutdownHook$ShutdownHookThread(134): Shutdown hook finished.