2015-06-15 03:29:19,669 INFO [main] hbase.ResourceChecker(147): before: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=4, OpenFileDescriptor=190, MaxFileDescriptor=32768, SystemLoadAverage=1108, ProcessCount=100, AvailableMemoryMB=3176, ConnectionCount=0 2015-06-15 03:29:20,343 INFO [Thread-1] regionserver.HRegion(5919): creating HRegion testReplayWorksThoughLotsOfFlushing HTD == 'testReplayWorksThoughLotsOfFlushing', {NAME => 'meta', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6 Table name == testReplayWorksThoughLotsOfFlushing 2015-06-15 03:29:21,140 WARN [Thread-1] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2015-06-15 03:29:23,700 WARN [Thread-1] impl.MetricsConfig(124): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2015-06-15 03:29:24,255 INFO [Thread-1] wal.WALFactory(144): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.DefaultWALProvider 2015-06-15 03:29:24,364 INFO [Thread-1] wal.FSHLog(553): WAL configuration: blocksize=32 MB, rollsize=30.40 MB, prefix=hregion-34734962.default, suffix=, logDir=file:/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/WALs/hregion-34734962, archiveDir=file:/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/oldWALs 2015-06-15 03:29:24,567 INFO [Thread-1] wal.FSHLog(1505): Slow sync cost: 0 ms, current pipeline: [] 2015-06-15 03:29:24,582 INFO [Thread-1] wal.FSHLog(980): New WAL /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/WALs/hregion-34734962/hregion-34734962.default.1434338964463 2015-06-15 03:29:24,582 INFO [Thread-1] wal.FSHLog(1542): FileSystem's output stream doesn't support getNumCurrentReplicas; HDFS-826 not available; fsOut=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer 2015-06-15 03:29:24,582 INFO [Thread-1] wal.FSHLog(2192): FileSystem's output stream doesn't support getPipeline; not available; fsOut=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer 2015-06-15 03:29:24,794 DEBUG [Thread-1] regionserver.HRegion(725): Instantiated testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. 2015-06-15 03:29:26,263 INFO [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] hfile.CacheConfig(488): Allocating LruBlockCache size=995.60 MB, blockSize=64 KB 2015-06-15 03:29:26,334 DEBUG [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] hfile.CacheConfig(502): Trying to use Internal l2 cache 2015-06-15 03:29:26,335 INFO [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042890544, maxSize=1043962304, heapSize=1071760, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2015-06-15 03:29:26,378 INFO [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] compactions.CompactionConfiguration(97): size [1048576, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 20971520; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 2015-06-15 03:29:26,381 DEBUG [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] regionserver.HRegionFileSystem(201): No StoreFiles for: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta 2015-06-15 03:29:26,495 DEBUG [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] util.ChecksumType$2(70): org.apache.hadoop.util.PureJavaCrc32 available 2015-06-15 03:29:26,497 DEBUG [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] util.ChecksumType$3(113): org.apache.hadoop.util.PureJavaCrc32C available 2015-06-15 03:29:26,528 DEBUG [Thread-1] regionserver.HRegion(3767): Found 0 recovered edits file(s) under /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:26,553 DEBUG [Thread-1] regionserver.FlushLargeStoresPolicy(56): hbase.hregion.percolumnfamilyflush.size.lower.bound is not specified, use global config(16777216) instead 2015-06-15 03:29:26,681 DEBUG [Thread-1] wal.WALSplitter(720): Wrote region seqId=/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/recovered.edits/2.seqid to file, newSeqId=2, maxSeqId=0 2015-06-15 03:29:26,681 INFO [Thread-1] regionserver.HRegion(851): Onlined 4823016d8fca70b25503ee07f4c6d79f; next sequenceid=2 2015-06-15 03:29:26,682 DEBUG [Thread-1] regionserver.HRegion(1354): Closing testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc.: disabling compactions & flushes 2015-06-15 03:29:26,682 DEBUG [Thread-1] regionserver.HRegion(1381): Updates disabled for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. 2015-06-15 03:29:26,690 INFO [StoreCloserThread-testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc.-1] regionserver.HStore(879): Closed meta 2015-06-15 03:29:26,691 INFO [Thread-1] regionserver.HRegion(1475): Closed testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. 2015-06-15 03:29:27,241 DEBUG [Thread-1] regionserver.HRegion(725): Instantiated testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. 2015-06-15 03:29:27,419 INFO [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042890544, maxSize=1043962304, heapSize=1071760, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2015-06-15 03:29:27,421 INFO [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] compactions.CompactionConfiguration(97): size [1048576, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 20971520; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 2015-06-15 03:29:27,424 DEBUG [StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1] regionserver.HRegionFileSystem(201): No StoreFiles for: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta 2015-06-15 03:29:27,426 DEBUG [Thread-1] regionserver.HRegion(3767): Found 1 recovered edits file(s) under /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:27,427 INFO [Thread-1] regionserver.HRegion(3864): Replaying edits from file:/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/recovered.edits/0000000000000016310 2015-06-15 03:29:28,623 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.01 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15861 2015-06-15 03:29:29,680 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15861, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/09a19fd41b8344709f88eef1b0f8855c 2015-06-15 03:29:29,925 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/09a19fd41b8344709f88eef1b0f8855c as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/09a19fd41b8344709f88eef1b0f8855c 2015-06-15 03:29:29,928 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/09a19fd41b8344709f88eef1b0f8855c, entries=5088, sequenceid=15861, filesize=413.2 K 2015-06-15 03:29:29,936 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.01 MB/1058304, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 1313ms, sequenceid=15861, compaction requested=false; wal=null 2015-06-15 03:29:30,632 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.04 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15877 2015-06-15 03:29:31,497 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15877, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0db82dfd43b943159ec696718196db63 2015-06-15 03:29:31,516 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0db82dfd43b943159ec696718196db63 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0db82dfd43b943159ec696718196db63 2015-06-15 03:29:31,540 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0db82dfd43b943159ec696718196db63, entries=5232, sequenceid=15877, filesize=426.7 K 2015-06-15 03:29:31,541 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.04 MB/1088256, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 908ms, sequenceid=15877, compaction requested=false; wal=null 2015-06-15 03:29:31,722 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.00 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15893 2015-06-15 03:29:32,272 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15893, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/53ee7151456d413c80412ff716e3bd8c 2015-06-15 03:29:32,287 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/53ee7151456d413c80412ff716e3bd8c as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/53ee7151456d413c80412ff716e3bd8c 2015-06-15 03:29:32,294 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/53ee7151456d413c80412ff716e3bd8c, entries=5049, sequenceid=15893, filesize=410.1 K 2015-06-15 03:29:32,295 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.00 MB/1050192, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 573ms, sequenceid=15893, compaction requested=true; wal=null 2015-06-15 03:29:32,441 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.01 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15911 2015-06-15 03:29:32,645 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15911, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/98305ea371b34d68a45b1f8c9e178ecb 2015-06-15 03:29:32,657 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/98305ea371b34d68a45b1f8c9e178ecb as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/98305ea371b34d68a45b1f8c9e178ecb 2015-06-15 03:29:32,663 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/98305ea371b34d68a45b1f8c9e178ecb, entries=5076, sequenceid=15911, filesize=412.2 K 2015-06-15 03:29:32,666 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.01 MB/1055808, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 225ms, sequenceid=15911, compaction requested=true; wal=null 2015-06-15 03:29:32,849 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.01 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15926 2015-06-15 03:29:32,978 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15926, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8d353d96801d4168b067d8f140171824 2015-06-15 03:29:33,010 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8d353d96801d4168b067d8f140171824 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8d353d96801d4168b067d8f140171824 2015-06-15 03:29:33,023 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8d353d96801d4168b067d8f140171824, entries=5103, sequenceid=15926, filesize=414.4 K 2015-06-15 03:29:33,024 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.01 MB/1061424, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 175ms, sequenceid=15926, compaction requested=true; wal=null 2015-06-15 03:29:33,176 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15943 2015-06-15 03:29:33,314 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15943, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/67c3f49fdaf84e96807f876abe5470a8 2015-06-15 03:29:33,330 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/67c3f49fdaf84e96807f876abe5470a8 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/67c3f49fdaf84e96807f876abe5470a8 2015-06-15 03:29:33,349 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/67c3f49fdaf84e96807f876abe5470a8, entries=5604, sequenceid=15943, filesize=456.3 K 2015-06-15 03:29:33,350 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1165632, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 174ms, sequenceid=15943, compaction requested=true; wal=null 2015-06-15 03:29:33,483 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.03 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15959 2015-06-15 03:29:33,559 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15959, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/4d241f9bed5249ed99b822c7ad89b553 2015-06-15 03:29:33,612 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/4d241f9bed5249ed99b822c7ad89b553 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/4d241f9bed5249ed99b822c7ad89b553 2015-06-15 03:29:33,616 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/4d241f9bed5249ed99b822c7ad89b553, entries=5214, sequenceid=15959, filesize=425.2 K 2015-06-15 03:29:33,624 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.03 MB/1084512, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 142ms, sequenceid=15959, compaction requested=true; wal=null 2015-06-15 03:29:33,724 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15977 2015-06-15 03:29:33,807 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15977, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a5a575df82174fc2a117bc0144f8fb27 2015-06-15 03:29:33,820 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a5a575df82174fc2a117bc0144f8fb27 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a5a575df82174fc2a117bc0144f8fb27 2015-06-15 03:29:33,835 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a5a575df82174fc2a117bc0144f8fb27, entries=5574, sequenceid=15977, filesize=453.9 K 2015-06-15 03:29:33,836 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1159392, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 112ms, sequenceid=15977, compaction requested=true; wal=null 2015-06-15 03:29:33,943 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.12 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=15995 2015-06-15 03:29:34,052 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=15995, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8c9c70d69fef4693b7d0369660b4fdbc 2015-06-15 03:29:34,059 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8c9c70d69fef4693b7d0369660b4fdbc as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8c9c70d69fef4693b7d0369660b4fdbc 2015-06-15 03:29:34,082 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8c9c70d69fef4693b7d0369660b4fdbc, entries=5658, sequenceid=15995, filesize=460.7 K 2015-06-15 03:29:34,083 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.12 MB/1176864, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 140ms, sequenceid=15995, compaction requested=true; wal=null 2015-06-15 03:29:34,180 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16014 2015-06-15 03:29:34,317 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16014, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/cb920fd89d2b49089b25a8fd132e5b8c 2015-06-15 03:29:34,359 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/cb920fd89d2b49089b25a8fd132e5b8c as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/cb920fd89d2b49089b25a8fd132e5b8c 2015-06-15 03:29:34,387 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/cb920fd89d2b49089b25a8fd132e5b8c, entries=5595, sequenceid=16014, filesize=455.6 K 2015-06-15 03:29:34,389 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1163760, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 209ms, sequenceid=16014, compaction requested=true; wal=null 2015-06-15 03:29:34,489 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.01 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16032 2015-06-15 03:29:34,568 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16032, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/5c23420f0f064057b7c8f97c93bc6d83 2015-06-15 03:29:34,583 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/5c23420f0f064057b7c8f97c93bc6d83 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/5c23420f0f064057b7c8f97c93bc6d83 2015-06-15 03:29:34,589 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/5c23420f0f064057b7c8f97c93bc6d83, entries=5112, sequenceid=16032, filesize=415.1 K 2015-06-15 03:29:34,604 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.01 MB/1063296, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 104ms, sequenceid=16032, compaction requested=true; wal=null 2015-06-15 03:29:34,662 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.09 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16048 2015-06-15 03:29:34,775 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16048, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0066ea1e2bda4f28aa4bc0c4e03645d3 2015-06-15 03:29:34,778 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0066ea1e2bda4f28aa4bc0c4e03645d3 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0066ea1e2bda4f28aa4bc0c4e03645d3 2015-06-15 03:29:34,792 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0066ea1e2bda4f28aa4bc0c4e03645d3, entries=5496, sequenceid=16048, filesize=447.7 K 2015-06-15 03:29:34,806 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.09 MB/1143168, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 144ms, sequenceid=16048, compaction requested=true; wal=null 2015-06-15 03:29:34,865 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.05 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16064 2015-06-15 03:29:34,945 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16064, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/555b6cd73d694a6aad900422baf2dcac 2015-06-15 03:29:34,967 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/555b6cd73d694a6aad900422baf2dcac as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/555b6cd73d694a6aad900422baf2dcac 2015-06-15 03:29:34,999 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/555b6cd73d694a6aad900422baf2dcac, entries=5313, sequenceid=16064, filesize=433.1 K 2015-06-15 03:29:35,014 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.05 MB/1105104, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 149ms, sequenceid=16064, compaction requested=true; wal=null 2015-06-15 03:29:35,090 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.02 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16080 2015-06-15 03:29:35,219 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16080, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/702886837dc544d7908b4bf061bb5142 2015-06-15 03:29:35,222 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/702886837dc544d7908b4bf061bb5142 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/702886837dc544d7908b4bf061bb5142 2015-06-15 03:29:35,249 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/702886837dc544d7908b4bf061bb5142, entries=5133, sequenceid=16080, filesize=418.8 K 2015-06-15 03:29:35,250 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.02 MB/1067664, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 161ms, sequenceid=16080, compaction requested=true; wal=null 2015-06-15 03:29:35,372 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.10 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16101 2015-06-15 03:29:35,459 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16101, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0200773827354b2eb556404d4d69e4d3 2015-06-15 03:29:35,479 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/0200773827354b2eb556404d4d69e4d3 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0200773827354b2eb556404d4d69e4d3 2015-06-15 03:29:35,482 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/0200773827354b2eb556404d4d69e4d3, entries=5565, sequenceid=16101, filesize=453.2 K 2015-06-15 03:29:35,495 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.10 MB/1157520, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 123ms, sequenceid=16101, compaction requested=true; wal=null 2015-06-15 03:29:35,565 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.03 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16114 2015-06-15 03:29:35,642 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16114, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/35dc4ff95019469a8d710b6009802a6a 2015-06-15 03:29:35,649 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/35dc4ff95019469a8d710b6009802a6a as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/35dc4ff95019469a8d710b6009802a6a 2015-06-15 03:29:35,666 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/35dc4ff95019469a8d710b6009802a6a, entries=5190, sequenceid=16114, filesize=423.3 K 2015-06-15 03:29:35,666 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.03 MB/1079520, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 101ms, sequenceid=16114, compaction requested=true; wal=null 2015-06-15 03:29:35,777 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.10 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16132 2015-06-15 03:29:35,842 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16132, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a07b17b40fa447c98d30020e8247325e 2015-06-15 03:29:35,854 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a07b17b40fa447c98d30020e8247325e as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a07b17b40fa447c98d30020e8247325e 2015-06-15 03:29:35,864 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a07b17b40fa447c98d30020e8247325e, entries=5565, sequenceid=16132, filesize=453.2 K 2015-06-15 03:29:35,864 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.10 MB/1157520, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 87ms, sequenceid=16132, compaction requested=true; wal=null 2015-06-15 03:29:35,932 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.00 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16148 2015-06-15 03:29:35,992 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16148, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a3af9a8d7e3c4f30a84ad931daef993c 2015-06-15 03:29:36,002 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a3af9a8d7e3c4f30a84ad931daef993c as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a3af9a8d7e3c4f30a84ad931daef993c 2015-06-15 03:29:36,015 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a3af9a8d7e3c4f30a84ad931daef993c, entries=5043, sequenceid=16148, filesize=409.6 K 2015-06-15 03:29:36,015 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.00 MB/1048944, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 83ms, sequenceid=16148, compaction requested=true; wal=null 2015-06-15 03:29:36,141 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16166 2015-06-15 03:29:36,196 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16166, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/12f8ce02e59b40a692a552d1682aec3b 2015-06-15 03:29:36,198 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/12f8ce02e59b40a692a552d1682aec3b as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/12f8ce02e59b40a692a552d1682aec3b 2015-06-15 03:29:36,216 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/12f8ce02e59b40a692a552d1682aec3b, entries=5589, sequenceid=16166, filesize=455.1 K 2015-06-15 03:29:36,233 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1162512, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 92ms, sequenceid=16166, compaction requested=true; wal=null 2015-06-15 03:29:36,301 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.09 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16185 2015-06-15 03:29:36,368 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16185, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/be47a46b82c74b3fbc231f33eea36218 2015-06-15 03:29:36,372 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/be47a46b82c74b3fbc231f33eea36218 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/be47a46b82c74b3fbc231f33eea36218 2015-06-15 03:29:36,382 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/be47a46b82c74b3fbc231f33eea36218, entries=5496, sequenceid=16185, filesize=447.7 K 2015-06-15 03:29:36,387 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.09 MB/1143168, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 87ms, sequenceid=16185, compaction requested=true; wal=null 2015-06-15 03:29:36,463 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16202 2015-06-15 03:29:36,531 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16202, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/36acb0dc66824541b20d0e9384ead34e 2015-06-15 03:29:36,537 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/36acb0dc66824541b20d0e9384ead34e as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/36acb0dc66824541b20d0e9384ead34e 2015-06-15 03:29:36,557 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/36acb0dc66824541b20d0e9384ead34e, entries=5571, sequenceid=16202, filesize=453.7 K 2015-06-15 03:29:36,559 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1158768, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 96ms, sequenceid=16202, compaction requested=true; wal=null 2015-06-15 03:29:36,613 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.11 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16222 2015-06-15 03:29:36,702 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16222, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/ea15b981a0734a4ca8fc579c993ebf98 2015-06-15 03:29:36,715 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/ea15b981a0734a4ca8fc579c993ebf98 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/ea15b981a0734a4ca8fc579c993ebf98 2015-06-15 03:29:36,727 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/ea15b981a0734a4ca8fc579c993ebf98, entries=5604, sequenceid=16222, filesize=456.3 K 2015-06-15 03:29:36,728 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.11 MB/1165632, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 115ms, sequenceid=16222, compaction requested=true; wal=null 2015-06-15 03:29:36,809 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.09 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16239 2015-06-15 03:29:36,866 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16239, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/3944fef3298b461c8abf6514cede48b6 2015-06-15 03:29:36,878 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/3944fef3298b461c8abf6514cede48b6 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/3944fef3298b461c8abf6514cede48b6 2015-06-15 03:29:36,881 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/3944fef3298b461c8abf6514cede48b6, entries=5484, sequenceid=16239, filesize=446.8 K 2015-06-15 03:29:36,896 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.09 MB/1140672, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 90ms, sequenceid=16239, compaction requested=true; wal=null 2015-06-15 03:29:36,933 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.09 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16256 2015-06-15 03:29:37,026 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16256, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8beba66ad558492aa38b57e8b26a09f6 2015-06-15 03:29:37,029 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/8beba66ad558492aa38b57e8b26a09f6 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8beba66ad558492aa38b57e8b26a09f6 2015-06-15 03:29:37,045 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/8beba66ad558492aa38b57e8b26a09f6, entries=5484, sequenceid=16256, filesize=446.8 K 2015-06-15 03:29:37,046 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.09 MB/1140672, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 113ms, sequenceid=16256, compaction requested=true; wal=null 2015-06-15 03:29:37,129 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.07 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16274 2015-06-15 03:29:37,213 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16274, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/3ed6c403a271422591d45ca003a2df84 2015-06-15 03:29:37,215 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/3ed6c403a271422591d45ca003a2df84 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/3ed6c403a271422591d45ca003a2df84 2015-06-15 03:29:37,222 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/3ed6c403a271422591d45ca003a2df84, entries=5382, sequenceid=16274, filesize=438.6 K 2015-06-15 03:29:37,225 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.07 MB/1119456, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 96ms, sequenceid=16274, compaction requested=true; wal=null 2015-06-15 03:29:37,288 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.03 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16290 2015-06-15 03:29:37,340 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16290, memsize=1.0 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/55853f386d6a407e9bbc01300d022320 2015-06-15 03:29:37,353 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/55853f386d6a407e9bbc01300d022320 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/55853f386d6a407e9bbc01300d022320 2015-06-15 03:29:37,362 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/55853f386d6a407e9bbc01300d022320, entries=5172, sequenceid=16290, filesize=421.9 K 2015-06-15 03:29:37,362 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.03 MB/1075776, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 74ms, sequenceid=16290, compaction requested=true; wal=null 2015-06-15 03:29:37,414 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 1.13 MB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16309 2015-06-15 03:29:37,475 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16309, memsize=1.1 M, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/d4fa22847ff348d3a3abb6f31fa9fd37 2015-06-15 03:29:37,480 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/d4fa22847ff348d3a3abb6f31fa9fd37 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/d4fa22847ff348d3a3abb6f31fa9fd37 2015-06-15 03:29:37,489 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/d4fa22847ff348d3a3abb6f31fa9fd37, entries=5691, sequenceid=16309, filesize=463.4 K 2015-06-15 03:29:37,493 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~1.13 MB/1183728, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 80ms, sequenceid=16309, compaction requested=true; wal=null 2015-06-15 03:29:37,495 DEBUG [Thread-1] regionserver.HRegion(4029): Applied 145761, skipped 2, firstSequenceIdInLog=15845, maxSequenceIdInLog=16310, path=file:/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/recovered.edits/0000000000000016310 2015-06-15 03:29:37,507 INFO [Thread-1] regionserver.HRegion(2088): Started memstore flush for testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc., current region memstore size 137.72 KB, and 1/1 column families' memstores are being flushed.; wal is null, using passed sequenceid=16310 2015-06-15 03:29:37,521 INFO [Thread-1] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=16310, memsize=137.7 K, hasBloomFilter=true, into tmp file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a4115e83547541579108f1771f7ea044 2015-06-15 03:29:37,529 DEBUG [Thread-1] regionserver.HRegionFileSystem(381): Committing store file /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/.tmp/a4115e83547541579108f1771f7ea044 as /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a4115e83547541579108f1771f7ea044 2015-06-15 03:29:37,532 INFO [Thread-1] regionserver.HStore(973): Added /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/meta/a4115e83547541579108f1771f7ea044, entries=678, sequenceid=16310, filesize=59.5 K 2015-06-15 03:29:37,532 INFO [Thread-1] regionserver.HRegion(2367): Finished memstore flush of ~137.72 KB/141024, currentsize=0 B/0 for region testReplayWorksThoughLotsOfFlushing,,1434338959977.e11b1805201c8112843a1229c70020fc. in 25ms, sequenceid=16310, compaction requested=true; wal=null 2015-06-15 03:29:37,544 DEBUG [Thread-1] regionserver.HRegion(3844): Deleted recovered.edits file=file:/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/recovered.edits/0000000000000016310 2015-06-15 03:29:37,545 DEBUG [Thread-1] regionserver.FlushLargeStoresPolicy(56): hbase.hregion.percolumnfamilyflush.size.lower.bound is not specified, use global config(16777216) instead 2015-06-15 03:29:37,572 DEBUG [Thread-1] wal.WALSplitter(720): Wrote region seqId=/grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f/recovered.edits/16311.seqid to file, newSeqId=16311, maxSeqId=2 2015-06-15 03:29:37,573 INFO [Thread-1] regionserver.HRegion(851): Onlined 4823016d8fca70b25503ee07f4c6d79f; next sequenceid=16311 2015-06-15 03:29:49,717 INFO [Thread-1] regionserver.HRegion(7662): Interrupted while waiting for a lock 2015-06-15 03:29:49,824 INFO [main] hbase.ResourceChecker(171): after: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14 (was 4) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: sync.3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: sync.0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: sync.1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: sync.2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: sync.4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: Thread-1.append-pool1-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45) com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55) com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: StoreOpener-4823016d8fca70b25503ee07f4c6d79f-1.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:803) java.lang.Thread.run(Thread.java:745) - Thread LEAK? -, OpenFileDescriptor=251 (was 190) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=1081 (was 1108), ProcessCount=100 (was 100), AvailableMemoryMB=2903 (was 3176), ConnectionCount=0 (was 0) 2015-06-15 03:29:49,907 INFO [main] hbase.ResourceChecker(147): before: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14, OpenFileDescriptor=253, MaxFileDescriptor=32768, SystemLoadAverage=1081, ProcessCount=100, AvailableMemoryMB=2901, ConnectionCount=0 2015-06-15 03:29:50,065 INFO [Thread-38] regionserver.HRegion(5919): creating HRegion testReplayWorksThoughLotsOfFlushing HTD == 'testReplayWorksThoughLotsOfFlushing', {NAME => 'meta', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6 Table name == testReplayWorksThoughLotsOfFlushing 2015-06-15 03:29:50,077 WARN [Thread-38] regionserver.HRegionFileSystem(876): Trying to create a region that already exists on disk: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:50,130 INFO [main] hbase.ResourceChecker(171): after: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14 (was 14), OpenFileDescriptor=251 (was 253), MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=1081 (was 1081), ProcessCount=100 (was 100), AvailableMemoryMB=2885 (was 2901), ConnectionCount=0 (was 0) 2015-06-15 03:29:50,177 INFO [main] hbase.ResourceChecker(147): before: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14, OpenFileDescriptor=251, MaxFileDescriptor=32768, SystemLoadAverage=1081, ProcessCount=100, AvailableMemoryMB=2867, ConnectionCount=0 2015-06-15 03:29:50,332 INFO [Thread-39] regionserver.HRegion(5919): creating HRegion testReplayWorksThoughLotsOfFlushing HTD == 'testReplayWorksThoughLotsOfFlushing', {NAME => 'meta', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6 Table name == testReplayWorksThoughLotsOfFlushing 2015-06-15 03:29:50,333 WARN [Thread-39] regionserver.HRegionFileSystem(876): Trying to create a region that already exists on disk: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:50,390 INFO [main] hbase.ResourceChecker(171): after: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14 (was 14), OpenFileDescriptor=251 (was 251), MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=1081 (was 1081), ProcessCount=100 (was 100), AvailableMemoryMB=2855 (was 2867), ConnectionCount=0 (was 0) 2015-06-15 03:29:50,472 INFO [main] hbase.ResourceChecker(147): before: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14, OpenFileDescriptor=251, MaxFileDescriptor=32768, SystemLoadAverage=1081, ProcessCount=100, AvailableMemoryMB=2850, ConnectionCount=0 2015-06-15 03:29:50,739 INFO [Thread-40] regionserver.HRegion(5919): creating HRegion testReplayWorksThoughLotsOfFlushing HTD == 'testReplayWorksThoughLotsOfFlushing', {NAME => 'meta', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6 Table name == testReplayWorksThoughLotsOfFlushing 2015-06-15 03:29:50,740 WARN [Thread-40] regionserver.HRegionFileSystem(876): Trying to create a region that already exists on disk: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:50,895 INFO [main] hbase.ResourceChecker(171): after: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14 (was 14), OpenFileDescriptor=251 (was 251), MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=1081 (was 1081), ProcessCount=100 (was 100), AvailableMemoryMB=2835 (was 2850), ConnectionCount=0 (was 0) 2015-06-15 03:29:50,940 INFO [main] hbase.ResourceChecker(147): before: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14, OpenFileDescriptor=251, MaxFileDescriptor=32768, SystemLoadAverage=1081, ProcessCount=100, AvailableMemoryMB=2830, ConnectionCount=0 2015-06-15 03:29:51,175 INFO [Thread-41] regionserver.HRegion(5919): creating HRegion testReplayWorksThoughLotsOfFlushing HTD == 'testReplayWorksThoughLotsOfFlushing', {NAME => 'meta', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6 Table name == testReplayWorksThoughLotsOfFlushing 2015-06-15 03:29:51,175 WARN [Thread-41] regionserver.HRegionFileSystem(876): Trying to create a region that already exists on disk: /grid/0/hbase/hbase-server/target/test-data/0c8ee429-8588-41ab-8999-6754588cd4a6/data/default/testReplayWorksThoughLotsOfFlushing/4823016d8fca70b25503ee07f4c6d79f 2015-06-15 03:29:51,352 INFO [main] hbase.ResourceChecker(171): after: regionserver.TestRecoveredEdits#testReplayWorksThoughLotsOfFlushing Thread=14 (was 14), OpenFileDescriptor=251 (was 251), MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=1081 (was 1081), ProcessCount=100 (was 100), AvailableMemoryMB=2812 (was 2830), ConnectionCount=0 (was 0)