2018-01-13 17:45:47,673 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToBigCellChunkMap[0] Thread=7, OpenFileDescriptor=231, MaxFileDescriptor=1048576, SystemLoadAverage=770, ProcessCount=200, AvailableMemoryMB=3445 2018-01-13 17:45:47,689 DEBUG [Time-limited test] util.ClassSize(229): Using Unsafe to estimate memory layout 2018-01-13 17:45:48,735 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:48,736 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:48,817 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74 2018-01-13 17:45:49,165 WARN [Time-limited test] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2018-01-13 17:45:49,567 INFO [Time-limited test] metrics.MetricRegistriesLoader(66): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-01-13 17:45:49,602 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:49,927 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2018-01-13 17:45:50,721 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-92492821, suffix=, logDir=file:/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/WALs/hregion-92492821, archiveDir=file:/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/oldWALs 2018-01-13 17:45:50,972 WARN [Time-limited test] util.CommonFSUtils$StreamCapabilities(824): Your Hadoop installation does not include the StreamCapabilities class from HDFS-11644, so we will skip checking if any FSDataOutputStreams actually support hflush/hsync. If you are running on top of HDFS this probably just means you have an older version and this can be ignored. If you are running on top of an alternate FileSystem implementation you should manually verify that hflush and hsync are implemented; otherwise you risk data loss and hard to diagnose errors when our assumptions are violated. 2018-01-13 17:45:50,973 DEBUG [Time-limited test] util.CommonFSUtils$StreamCapabilities(831): The first request to check for StreamCapabilities came from this stacktrace. java.lang.ClassNotFoundException: org.apache.hadoop.fs.StreamCapabilities at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.util.CommonFSUtils$StreamCapabilities.(CommonFSUtils.java:820) at org.apache.hadoop.hbase.util.CommonFSUtils.hasCapability(CommonFSUtils.java:858) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:66) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:159) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:167) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:99) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:628) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:130) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:766) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:504) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.(AsyncFSWAL.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createWAL(AsyncFSWALProvider.java:69) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createWAL(AsyncFSWALProvider.java:44) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:55) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:244) at org.apache.hadoop.hbase.HBaseTestingUtility.createWal(HBaseTestingUtility.java:2315) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:107) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:51,086 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/WALs/hregion-92492821/hregion-92492821.1515883550759 2018-01-13 17:45:51,088 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:51,109 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74 Table name == foobar 2018-01-13 17:45:51,305 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883548893.fe42d239f3b63a1f1a24c7cc5acb8498. 2018-01-13 17:45:51,685 WARN [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] util.CommonFSUtils(536): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:51,716 INFO [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:51,718 INFO [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:51,722 INFO [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] hfile.CacheConfig(553): Allocating On heap LruBlockCache size=995.60 MB, blockSize=64 KB 2018-01-13 17:45:51,745 INFO [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:51,759 INFO [StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:51,786 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883548893.fe42d239f3b63a1f1a24c7cc5acb8498. 2018-01-13 17:45:51,804 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/data/default/foobar/fe42d239f3b63a1f1a24c7cc5acb8498 2018-01-13 17:45:51,818 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:51,828 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/data/default/foobar/fe42d239f3b63a1f1a24c7cc5acb8498/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:51,829 INFO [Time-limited test] regionserver.HRegion(960): Onlined fe42d239f3b63a1f1a24c7cc5acb8498; next sequenceid=2 2018-01-13 17:45:51,830 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:51,832 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:51,832 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:51,832 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:51,833 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:51,837 INFO [Time-limited test] regionserver.ChunkCreator(410): Allocating MemStoreChunkPool with chunk size 2 MB, max count 199, initial count 0 2018-01-13 17:45:51,892 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:51,922 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x5C\xAD\x04, timestamp:1515883551917 2018-01-13 17:45:51,924 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x5C\xB2\x04, timestamp:1515883551922 2018-01-13 17:45:51,927 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x5C\xB6\x04, timestamp:1515883551926 2018-01-13 17:45:51,929 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x5C\xB8\x04, timestamp:1515883551928 2018-01-13 17:45:51,931 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:51,931 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:51,939 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=4, cellSize=1048752, totalHeapSize=1049336, min timestamp=1515883551917, max timestamp=1515883551928Num uniques -1; flattened 2018-01-13 17:45:51,940 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883548893.fe42d239f3b63a1f1a24c7cc5acb8498.store: column 2018-01-13 17:45:51,940 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:51,962 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToBigCellChunkMap[0] Thread=17 (was 7) Potentially hanging thread: Time-limited test-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/WALs/hregion-92492821/hregion-92492821.1515883550759 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3063) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:302) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSWAL-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: StoreOpener-fe42d239f3b63a1f1a24c7cc5acb8498-1.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:894) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=237 (was 231) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 770) - SystemLoadAverage LEAK? -, ProcessCount=199 (was 200), AvailableMemoryMB=2700 (was 3445) 2018-01-13 17:45:51,978 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByScan[0] Thread=17, OpenFileDescriptor=239, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=199, AvailableMemoryMB=2699 2018-01-13 17:45:52,036 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:52,037 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:52,037 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45 2018-01-13 17:45:52,038 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45 2018-01-13 17:45:52,038 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:52,039 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45 2018-01-13 17:45:52,043 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:52,046 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-36457653, suffix=, logDir=file:/ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/WALs/hregion-36457653, archiveDir=file:/ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/oldWALs 2018-01-13 17:45:52,069 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/WALs/hregion-36457653/hregion-36457653.1515883552048 2018-01-13 17:45:52,070 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:52,070 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45 Table name == foobar 2018-01-13 17:45:52,112 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883552040.08d13d8a978ef5b774e9ac54db3685cb. 2018-01-13 17:45:52,122 DEBUG [StoreOpener-08d13d8a978ef5b774e9ac54db3685cb-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:52,128 INFO [StoreOpener-08d13d8a978ef5b774e9ac54db3685cb-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,128 INFO [StoreOpener-08d13d8a978ef5b774e9ac54db3685cb-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:52,139 INFO [StoreOpener-08d13d8a978ef5b774e9ac54db3685cb-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:52,143 INFO [StoreOpener-08d13d8a978ef5b774e9ac54db3685cb-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:52,144 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883552040.08d13d8a978ef5b774e9ac54db3685cb. 2018-01-13 17:45:52,145 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/data/default/foobar/08d13d8a978ef5b774e9ac54db3685cb 2018-01-13 17:45:52,146 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:52,169 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/data/default/foobar/08d13d8a978ef5b774e9ac54db3685cb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:52,170 INFO [Time-limited test] regionserver.HRegion(960): Onlined 08d13d8a978ef5b774e9ac54db3685cb; next sequenceid=2 2018-01-13 17:45:52,170 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:52,172 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,172 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:52,172 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:52,173 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:52,218 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,276 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:52,282 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:52,350 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=150, cellSize=7290, totalHeapSize=11976, min timestamp=1515883552218, max timestamp=1515883552266Num uniques 150; 2018-01-13 17:45:52,351 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=7290, new segment data size=7290, suffix heap size=19176,new segment heap size=11976 2018-01-13 17:45:52,380 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByScan[0] Thread=19 (was 17) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/a5bff76d-9ecc-4c2f-8cbd-8387e387be45/WALs/hregion-36457653/hregion-36457653.1515883552048 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=242 (was 239) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=199 (was 199), AvailableMemoryMB=2688 (was 2699) 2018-01-13 17:45:52,393 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToJumboCellChunkMap[0] Thread=19, OpenFileDescriptor=244, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=199, AvailableMemoryMB=2686 2018-01-13 17:45:52,457 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:52,466 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:52,466 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/808814d0-01ec-4017-a142-bafc55656955 2018-01-13 17:45:52,466 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/808814d0-01ec-4017-a142-bafc55656955 2018-01-13 17:45:52,467 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:52,467 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/808814d0-01ec-4017-a142-bafc55656955 2018-01-13 17:45:52,468 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:52,492 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-29601438, suffix=, logDir=file:/ram4G/808814d0-01ec-4017-a142-bafc55656955/WALs/hregion-29601438, archiveDir=file:/ram4G/808814d0-01ec-4017-a142-bafc55656955/oldWALs 2018-01-13 17:45:52,581 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/808814d0-01ec-4017-a142-bafc55656955/WALs/hregion-29601438/hregion-29601438.1515883552494 2018-01-13 17:45:52,582 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:52,582 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/808814d0-01ec-4017-a142-bafc55656955 Table name == foobar 2018-01-13 17:45:52,625 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883552467.d406c3e8f1f44efc9e05794b5bded000. 2018-01-13 17:45:52,634 DEBUG [StoreOpener-d406c3e8f1f44efc9e05794b5bded000-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:52,635 INFO [StoreOpener-d406c3e8f1f44efc9e05794b5bded000-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,636 INFO [StoreOpener-d406c3e8f1f44efc9e05794b5bded000-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:52,636 INFO [StoreOpener-d406c3e8f1f44efc9e05794b5bded000-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:52,637 INFO [StoreOpener-d406c3e8f1f44efc9e05794b5bded000-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:52,639 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883552467.d406c3e8f1f44efc9e05794b5bded000. 2018-01-13 17:45:52,639 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/808814d0-01ec-4017-a142-bafc55656955/data/default/foobar/d406c3e8f1f44efc9e05794b5bded000 2018-01-13 17:45:52,640 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:52,658 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/808814d0-01ec-4017-a142-bafc55656955/data/default/foobar/d406c3e8f1f44efc9e05794b5bded000/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:52,658 INFO [Time-limited test] regionserver.HRegion(960): Onlined d406c3e8f1f44efc9e05794b5bded000; next sequenceid=2 2018-01-13 17:45:52,658 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:52,659 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,660 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:52,660 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:52,661 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:52,713 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:52,785 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3`\x08\x04, timestamp:1515883552776 2018-01-13 17:45:52,786 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:52,786 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:52,789 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=1, cellSize=2097196, totalHeapSize=2097504, min timestamp=1515883552776, max timestamp=1515883552776Num uniques -1; flattened 2018-01-13 17:45:52,789 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883552467.d406c3e8f1f44efc9e05794b5bded000.store: column 2018-01-13 17:45:52,789 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:52,796 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3`\x16\x04, timestamp:1515883552790 2018-01-13 17:45:52,819 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3`\x1D\x04, timestamp:1515883552797 2018-01-13 17:45:52,822 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(854): added kv: \x00\x01E\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3`3\x04, timestamp:1515883552819 2018-01-13 17:45:52,824 DEBUG [Time-limited test-inmemoryCompactions-1515883552809] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:52,825 DEBUG [Time-limited test-inmemoryCompactions-1515883552809] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:52,842 DEBUG [Time-limited test-inmemoryCompactions-1515883552809] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=3, cellSize=6291588, totalHeapSize=6292080, min timestamp=1515883552790, max timestamp=1515883552819Num uniques -1; flattened 2018-01-13 17:45:52,886 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToJumboCellChunkMap[0] Thread=21 (was 19) Potentially hanging thread: Time-limited test-inmemoryCompactions-1515883552809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/808814d0-01ec-4017-a142-bafc55656955/WALs/hregion-29601438/hregion-29601438.1515883552494 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=245 (was 244) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=199 (was 199), AvailableMemoryMB=2633 (was 2686) 2018-01-13 17:45:52,917 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMerging[0] Thread=21, OpenFileDescriptor=247, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=199, AvailableMemoryMB=2632 2018-01-13 17:45:52,980 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:52,983 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:52,983 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079 2018-01-13 17:45:52,983 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079 2018-01-13 17:45:52,984 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:52,984 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079 2018-01-13 17:45:52,987 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:52,993 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-39106121, suffix=, logDir=file:/ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/WALs/hregion-39106121, archiveDir=file:/ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/oldWALs 2018-01-13 17:45:53,029 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/WALs/hregion-39106121/hregion-39106121.1515883552999 2018-01-13 17:45:53,030 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:53,030 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079 Table name == foobar 2018-01-13 17:45:53,050 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883552985.b0a13124497bf21f72b9620d2a327ab1. 2018-01-13 17:45:53,055 DEBUG [StoreOpener-b0a13124497bf21f72b9620d2a327ab1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,058 INFO [StoreOpener-b0a13124497bf21f72b9620d2a327ab1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,059 INFO [StoreOpener-b0a13124497bf21f72b9620d2a327ab1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,064 INFO [StoreOpener-b0a13124497bf21f72b9620d2a327ab1-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,068 INFO [StoreOpener-b0a13124497bf21f72b9620d2a327ab1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,070 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883552985.b0a13124497bf21f72b9620d2a327ab1. 2018-01-13 17:45:53,070 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/data/default/foobar/b0a13124497bf21f72b9620d2a327ab1 2018-01-13 17:45:53,071 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:53,116 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/data/default/foobar/b0a13124497bf21f72b9620d2a327ab1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:53,116 INFO [Time-limited test] regionserver.HRegion(960): Onlined b0a13124497bf21f72b9620d2a327ab1; next sequenceid=2 2018-01-13 17:45:53,116 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,122 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,122 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,122 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,123 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,174 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,177 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\x96\x04, timestamp1515883553174 2018-01-13 17:45:53,182 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\x99\x04, timestamp1515883553177 2018-01-13 17:45:53,184 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\x9F\x04, timestamp1515883553183 2018-01-13 17:45:53,185 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA0\x04, timestamp1515883553184 2018-01-13 17:45:53,187 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01F\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA1\x04, timestamp1515883553185 2018-01-13 17:45:53,188 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01H\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA3\x04, timestamp1515883553187 2018-01-13 17:45:53,189 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:53,189 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:53,190 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=6, cellSize=276, totalHeapSize=936, min timestamp=1515883553174, max timestamp=1515883553187Num uniques -1; flattened 2018-01-13 17:45:53,192 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA6\x04, timestamp1515883553190 2018-01-13 17:45:53,193 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA8\x04, timestamp1515883553192 2018-01-13 17:45:53,194 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xA9\x04, timestamp1515883553193 2018-01-13 17:45:53,196 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01G\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xAB\x04, timestamp1515883553195 2018-01-13 17:45:53,198 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01I\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xAC\x04, timestamp1515883553196 2018-01-13 17:45:53,199 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01J\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xAE\x04, timestamp1515883553198 2018-01-13 17:45:53,202 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xAF\x04, timestamp1515883553199 2018-01-13 17:45:53,204 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xB2\x04, timestamp1515883553202 2018-01-13 17:45:53,205 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xB4\x04, timestamp1515883553204 2018-01-13 17:45:53,206 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01E\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3a\xB5\x04, timestamp1515883553205 2018-01-13 17:45:53,207 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:53,207 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:53,208 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=696, min timestamp=1515883553199, max timestamp=1515883553205Num uniques -1; flattened 2018-01-13 17:45:53,208 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883552985.b0a13124497bf21f72b9620d2a327ab1.store: column 2018-01-13 17:45:53,209 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=null 2018-01-13 17:45:53,244 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMerging[0] Thread=23 (was 21) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/179403cc-6ddd-43e2-96d7-949da6ead079/WALs/hregion-39106121/hregion-39106121.1515883552999 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=250 (was 247) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=199 (was 199), AvailableMemoryMB=2617 (was 2632) 2018-01-13 17:45:53,276 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterMerge[0] Thread=23, OpenFileDescriptor=250, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=200, AvailableMemoryMB=2616 2018-01-13 17:45:53,326 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:53,334 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:53,334 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad 2018-01-13 17:45:53,335 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad 2018-01-13 17:45:53,335 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:53,336 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad 2018-01-13 17:45:53,338 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:53,355 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-05703615, suffix=, logDir=file:/ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/WALs/hregion-05703615, archiveDir=file:/ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/oldWALs 2018-01-13 17:45:53,415 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/WALs/hregion-05703615/hregion-05703615.1515883553357 2018-01-13 17:45:53,416 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:53,416 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad Table name == foobar 2018-01-13 17:45:53,425 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883553336.42c334a0c8227c9553384aac55ec4a95. 2018-01-13 17:45:53,434 DEBUG [StoreOpener-42c334a0c8227c9553384aac55ec4a95-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,435 INFO [StoreOpener-42c334a0c8227c9553384aac55ec4a95-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,439 INFO [StoreOpener-42c334a0c8227c9553384aac55ec4a95-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,441 INFO [StoreOpener-42c334a0c8227c9553384aac55ec4a95-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,452 INFO [StoreOpener-42c334a0c8227c9553384aac55ec4a95-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,454 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883553336.42c334a0c8227c9553384aac55ec4a95. 2018-01-13 17:45:53,455 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/data/default/foobar/42c334a0c8227c9553384aac55ec4a95 2018-01-13 17:45:53,455 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:53,477 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/data/default/foobar/42c334a0c8227c9553384aac55ec4a95/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:53,477 INFO [Time-limited test] regionserver.HRegion(960): Onlined 42c334a0c8227c9553384aac55ec4a95; next sequenceid=2 2018-01-13 17:45:53,477 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,478 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,478 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,479 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,479 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,504 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,534 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:53,535 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:53,535 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=2, cellSize=64, totalHeapSize=424, min timestamp=101, max timestamp=102Num uniques -1; flattened 2018-01-13 17:45:53,543 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:53,543 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:53,544 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=2, cellSize=64, totalHeapSize=424, min timestamp=103, max timestamp=104Num uniques -1; flattened 2018-01-13 17:45:53,586 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterMerge[0] Thread=25 (was 23) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/3e7db85e-2bbe-4eb3-8384-ad9c8903ecad/WALs/hregion-05703615/hregion-05703615.1515883553357 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=255 (was 250) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=200 (was 200), AvailableMemoryMB=2585 (was 2616) 2018-01-13 17:45:53,616 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByIterator[0] Thread=25, OpenFileDescriptor=257, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=201, AvailableMemoryMB=2581 2018-01-13 17:45:53,673 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:53,674 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:53,674 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f 2018-01-13 17:45:53,674 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f 2018-01-13 17:45:53,675 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:53,676 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f 2018-01-13 17:45:53,677 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:53,685 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-12403770, suffix=, logDir=file:/ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/WALs/hregion-12403770, archiveDir=file:/ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/oldWALs 2018-01-13 17:45:53,738 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/WALs/hregion-12403770/hregion-12403770.1515883553686 2018-01-13 17:45:53,738 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:53,739 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f Table name == foobar 2018-01-13 17:45:53,770 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883553676.7bd95628cf45294c3eec1b32d3ee9e68. 2018-01-13 17:45:53,775 DEBUG [StoreOpener-7bd95628cf45294c3eec1b32d3ee9e68-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,776 INFO [StoreOpener-7bd95628cf45294c3eec1b32d3ee9e68-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,777 INFO [StoreOpener-7bd95628cf45294c3eec1b32d3ee9e68-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,779 INFO [StoreOpener-7bd95628cf45294c3eec1b32d3ee9e68-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,780 INFO [StoreOpener-7bd95628cf45294c3eec1b32d3ee9e68-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,783 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883553676.7bd95628cf45294c3eec1b32d3ee9e68. 2018-01-13 17:45:53,785 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/data/default/foobar/7bd95628cf45294c3eec1b32d3ee9e68 2018-01-13 17:45:53,785 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:53,818 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/data/default/foobar/7bd95628cf45294c3eec1b32d3ee9e68/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:53,818 INFO [Time-limited test] regionserver.HRegion(960): Onlined 7bd95628cf45294c3eec1b32d3ee9e68; next sequenceid=2 2018-01-13 17:45:53,819 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:53,819 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,820 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:53,820 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:53,820 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:53,887 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:53,914 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:53,919 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:53,944 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=150, cellSize=7290, totalHeapSize=11976, min timestamp=1515883553888, max timestamp=1515883553911Num uniques 150; 2018-01-13 17:45:53,945 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=7290, new segment data size=7290, suffix heap size=19176,new segment heap size=11976 2018-01-13 17:45:53,995 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByIterator[0] Thread=28 (was 25) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/1678bdbd-c83e-416a-9f94-2c97353d481f/WALs/hregion-12403770/hregion-12403770.1515883553686 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=260 (was 257) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=200 (was 201), AvailableMemoryMB=2547 (was 2581) 2018-01-13 17:45:54,055 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterCompaction[0] Thread=27, OpenFileDescriptor=263, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=199, AvailableMemoryMB=2547 2018-01-13 17:45:54,135 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:54,135 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:54,135 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd 2018-01-13 17:45:54,137 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd 2018-01-13 17:45:54,137 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:54,137 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd 2018-01-13 17:45:54,141 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:54,146 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-54116183, suffix=, logDir=file:/ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/WALs/hregion-54116183, archiveDir=file:/ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/oldWALs 2018-01-13 17:45:54,226 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/WALs/hregion-54116183/hregion-54116183.1515883554148 2018-01-13 17:45:54,226 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:54,227 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd Table name == foobar 2018-01-13 17:45:54,238 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883554138.fcd706a803218733bb99797b4d9362a4. 2018-01-13 17:45:54,240 DEBUG [StoreOpener-fcd706a803218733bb99797b4d9362a4-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,242 INFO [StoreOpener-fcd706a803218733bb99797b4d9362a4-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,242 INFO [StoreOpener-fcd706a803218733bb99797b4d9362a4-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,242 INFO [StoreOpener-fcd706a803218733bb99797b4d9362a4-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,243 INFO [StoreOpener-fcd706a803218733bb99797b4d9362a4-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,244 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883554138.fcd706a803218733bb99797b4d9362a4. 2018-01-13 17:45:54,245 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/data/default/foobar/fcd706a803218733bb99797b4d9362a4 2018-01-13 17:45:54,245 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:54,254 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/data/default/foobar/fcd706a803218733bb99797b4d9362a4/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:54,254 INFO [Time-limited test] regionserver.HRegion(960): Onlined fcd706a803218733bb99797b4d9362a4; next sequenceid=2 2018-01-13 17:45:54,255 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,255 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,255 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,256 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,256 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,303 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,308 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:54,308 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:54,313 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=1, cellSize=32, totalHeapSize=272, min timestamp=102, max timestamp=102Num uniques 2; 2018-01-13 17:45:54,313 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883554138.fcd706a803218733bb99797b4d9362a4.) memstoreSize to a negative value which is incorrect. Current memstoreSize=0, delta=-32 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRange(TestCompactingToCellFlatMapMemStore.java:401) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRangeAfterCompaction(TestCompactingToCellFlatMapMemStore.java:366) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,314 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=64, new segment data size=32, suffix heap size=424,new segment heap size=272 2018-01-13 17:45:54,316 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:54,316 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 2 segments 2018-01-13 17:45:54,319 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=1, cellSize=32, totalHeapSize=272, min timestamp=104, max timestamp=104Num uniques 3; 2018-01-13 17:45:54,320 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883554138.fcd706a803218733bb99797b4d9362a4.) memstoreSize to a negative value which is incorrect. Current memstoreSize=-32, delta=-64 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRange(TestCompactingToCellFlatMapMemStore.java:421) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRangeAfterCompaction(TestCompactingToCellFlatMapMemStore.java:366) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,320 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=96, new segment data size=32, suffix heap size=696,new segment heap size=272 2018-01-13 17:45:54,332 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterCompaction[0] Thread=30 (was 27) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/480420cc-8e2b-43ed-b381-e3dffb5f91fd/WALs/hregion-54116183/hregion-54116183.1515883554148 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=265 (was 263) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=900 (was 900), ProcessCount=199 (was 199), AvailableMemoryMB=2515 (was 2547) 2018-01-13 17:45:54,377 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksAfterFlushing[0] Thread=29, OpenFileDescriptor=265, MaxFileDescriptor=1048576, SystemLoadAverage=900, ProcessCount=199, AvailableMemoryMB=2513 2018-01-13 17:45:54,415 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:54,416 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:54,416 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b 2018-01-13 17:45:54,416 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b 2018-01-13 17:45:54,416 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:54,417 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b 2018-01-13 17:45:54,417 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:54,420 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-08871663, suffix=, logDir=file:/ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/WALs/hregion-08871663, archiveDir=file:/ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/oldWALs 2018-01-13 17:45:54,428 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/WALs/hregion-08871663/hregion-08871663.1515883554422 2018-01-13 17:45:54,428 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:54,428 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b Table name == foobar 2018-01-13 17:45:54,452 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883554417.acb789daa4fc6e00ef4ce9880af44e71. 2018-01-13 17:45:54,463 DEBUG [StoreOpener-acb789daa4fc6e00ef4ce9880af44e71-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,464 INFO [StoreOpener-acb789daa4fc6e00ef4ce9880af44e71-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,464 INFO [StoreOpener-acb789daa4fc6e00ef4ce9880af44e71-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,464 INFO [StoreOpener-acb789daa4fc6e00ef4ce9880af44e71-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,465 INFO [StoreOpener-acb789daa4fc6e00ef4ce9880af44e71-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,466 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883554417.acb789daa4fc6e00ef4ce9880af44e71. 2018-01-13 17:45:54,466 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/data/default/foobar/acb789daa4fc6e00ef4ce9880af44e71 2018-01-13 17:45:54,467 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:54,480 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/data/default/foobar/acb789daa4fc6e00ef4ce9880af44e71/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:54,480 INFO [Time-limited test] regionserver.HRegion(960): Onlined acb789daa4fc6e00ef4ce9880af44e71; next sequenceid=2 2018-01-13 17:45:54,481 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,482 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,482 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,482 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,484 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,517 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,519 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883554417.acb789daa4fc6e00ef4ce9880af44e71.store: column 2018-01-13 17:45:54,519 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:54,537 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksAfterFlushing[0] Thread=32 (was 29) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/e9c47ad6-0fb4-4246-b67a-b79dd2eae21b/WALs/hregion-08871663/hregion-08871663.1515883554422 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=270 (was 265) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 900) - SystemLoadAverage LEAK? -, ProcessCount=199 (was 199), AvailableMemoryMB=2492 (was 2513) 2018-01-13 17:45:54,551 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningScanner[0] Thread=31, OpenFileDescriptor=272, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2492 2018-01-13 17:45:54,589 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:54,590 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:54,590 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625 2018-01-13 17:45:54,590 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625 2018-01-13 17:45:54,591 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:54,591 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625 2018-01-13 17:45:54,602 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:54,603 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-44695995, suffix=, logDir=file:/ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/WALs/hregion-44695995, archiveDir=file:/ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/oldWALs 2018-01-13 17:45:54,608 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/WALs/hregion-44695995/hregion-44695995.1515883554604 2018-01-13 17:45:54,608 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:54,609 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625 Table name == foobar 2018-01-13 17:45:54,617 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883554592.764f688bdc8df907543e200e6a08c5da. 2018-01-13 17:45:54,619 DEBUG [StoreOpener-764f688bdc8df907543e200e6a08c5da-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,621 INFO [StoreOpener-764f688bdc8df907543e200e6a08c5da-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,621 INFO [StoreOpener-764f688bdc8df907543e200e6a08c5da-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,621 INFO [StoreOpener-764f688bdc8df907543e200e6a08c5da-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,626 INFO [StoreOpener-764f688bdc8df907543e200e6a08c5da-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,627 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883554592.764f688bdc8df907543e200e6a08c5da. 2018-01-13 17:45:54,628 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/data/default/foobar/764f688bdc8df907543e200e6a08c5da 2018-01-13 17:45:54,628 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:54,642 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/data/default/foobar/764f688bdc8df907543e200e6a08c5da/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:54,642 INFO [Time-limited test] regionserver.HRegion(960): Onlined 764f688bdc8df907543e200e6a08c5da; next sequenceid=2 2018-01-13 17:45:54,643 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,643 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,643 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,644 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,644 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,672 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,673 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883554592.764f688bdc8df907543e200e6a08c5da.store: column 2018-01-13 17:45:54,674 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:54,675 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883554592.764f688bdc8df907543e200e6a08c5da.store: column 2018-01-13 17:45:54,676 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:54,689 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningScanner[0] Thread=33 (was 31) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/88b1ac9d-c7b7-44f9-b1f0-6b51c3839625/WALs/hregion-44695995/hregion-44695995.1515883554604 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=275 (was 272) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=201 (was 199) - ProcessCount LEAK? -, AvailableMemoryMB=2465 (was 2492) 2018-01-13 17:45:54,702 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToCellChunkMap[0] Thread=33, OpenFileDescriptor=277, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2466 2018-01-13 17:45:54,797 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:54,798 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:54,798 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a 2018-01-13 17:45:54,798 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a 2018-01-13 17:45:54,798 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:54,798 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a 2018-01-13 17:45:54,799 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:54,803 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-22481278, suffix=, logDir=file:/ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a/WALs/hregion-22481278, archiveDir=file:/ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a/oldWALs 2018-01-13 17:45:54,827 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a/WALs/hregion-22481278/hregion-22481278.1515883554803 2018-01-13 17:45:54,827 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:54,828 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a Table name == foobar 2018-01-13 17:45:54,833 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883554798.806f25d9b6d1f595d809c934c66aab79. 2018-01-13 17:45:54,835 DEBUG [StoreOpener-806f25d9b6d1f595d809c934c66aab79-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,836 INFO [StoreOpener-806f25d9b6d1f595d809c934c66aab79-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,836 INFO [StoreOpener-806f25d9b6d1f595d809c934c66aab79-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,837 INFO [StoreOpener-806f25d9b6d1f595d809c934c66aab79-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,838 INFO [StoreOpener-806f25d9b6d1f595d809c934c66aab79-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,839 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883554798.806f25d9b6d1f595d809c934c66aab79. 2018-01-13 17:45:54,840 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a/data/default/foobar/806f25d9b6d1f595d809c934c66aab79 2018-01-13 17:45:54,840 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:54,848 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/8e839362-91d9-4d40-87ac-80eb8ff1e34a/data/default/foobar/806f25d9b6d1f595d809c934c66aab79/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:54,848 INFO [Time-limited test] regionserver.HRegion(960): Onlined 806f25d9b6d1f595d809c934c66aab79; next sequenceid=2 2018-01-13 17:45:54,848 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,851 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,851 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,851 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,852 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,881 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,886 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hB\x04, timestamp:1515883554882 2018-01-13 17:45:54,887 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hF\x04, timestamp:1515883554886 2018-01-13 17:45:54,892 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hG\x04, timestamp:1515883554887 2018-01-13 17:45:54,894 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hM\x04, timestamp:1515883554893 2018-01-13 17:45:54,896 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hO\x04, timestamp:1515883554895 2018-01-13 17:45:54,903 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hV\x04, timestamp:1515883554902 2018-01-13 17:45:54,904 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01E\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hW\x04, timestamp:1515883554903 2018-01-13 17:45:54,906 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01F\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3hY\x04, timestamp:1515883554905 2018-01-13 17:45:54,906 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:54,906 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:54,907 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=8, cellSize=368, totalHeapSize=1176, min timestamp=1515883554882, max timestamp=1515883554905Num uniques -1; flattened 2018-01-13 17:45:54,907 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883554798.806f25d9b6d1f595d809c934c66aab79.store: column 2018-01-13 17:45:54,908 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:54,920 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToCellChunkMap[0] Thread=28 (was 33), OpenFileDescriptor=266 (was 277), MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2398 (was 2466) 2018-01-13 17:45:54,932 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetNextRow[0] Thread=28, OpenFileDescriptor=266, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2398 2018-01-13 17:45:54,957 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:54,958 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:54,958 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/9bbc7610-c186-4203-9896-eff64c379aec 2018-01-13 17:45:54,958 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/9bbc7610-c186-4203-9896-eff64c379aec 2018-01-13 17:45:54,959 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:54,959 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/9bbc7610-c186-4203-9896-eff64c379aec 2018-01-13 17:45:54,961 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:54,969 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-57187849, suffix=, logDir=file:/ram4G/9bbc7610-c186-4203-9896-eff64c379aec/WALs/hregion-57187849, archiveDir=file:/ram4G/9bbc7610-c186-4203-9896-eff64c379aec/oldWALs 2018-01-13 17:45:54,987 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/9bbc7610-c186-4203-9896-eff64c379aec/WALs/hregion-57187849/hregion-57187849.1515883554970 2018-01-13 17:45:54,987 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:54,987 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/9bbc7610-c186-4203-9896-eff64c379aec Table name == foobar 2018-01-13 17:45:54,993 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883554960.666f24da88b00ed46aec40a940adde16. 2018-01-13 17:45:54,995 DEBUG [StoreOpener-666f24da88b00ed46aec40a940adde16-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:54,995 INFO [StoreOpener-666f24da88b00ed46aec40a940adde16-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:54,996 INFO [StoreOpener-666f24da88b00ed46aec40a940adde16-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:54,996 INFO [StoreOpener-666f24da88b00ed46aec40a940adde16-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:54,996 INFO [StoreOpener-666f24da88b00ed46aec40a940adde16-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:54,997 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883554960.666f24da88b00ed46aec40a940adde16. 2018-01-13 17:45:54,997 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/9bbc7610-c186-4203-9896-eff64c379aec/data/default/foobar/666f24da88b00ed46aec40a940adde16 2018-01-13 17:45:54,998 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:55,006 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/9bbc7610-c186-4203-9896-eff64c379aec/data/default/foobar/666f24da88b00ed46aec40a940adde16/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:55,006 INFO [Time-limited test] regionserver.HRegion(960): Onlined 666f24da88b00ed46aec40a940adde16; next sequenceid=2 2018-01-13 17:45:55,006 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,007 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,007 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,007 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,008 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,049 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,263 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetNextRow[0] Thread=30 (was 28) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/9bbc7610-c186-4203-9896-eff64c379aec/WALs/hregion-57187849/hregion-57187849.1515883554970 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=271 (was 266) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2375 (was 2398) 2018-01-13 17:45:55,312 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testUpdateToTimeOfOldestEdit[0] Thread=30, OpenFileDescriptor=271, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2374 2018-01-13 17:45:55,334 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:55,335 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:55,335 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45 2018-01-13 17:45:55,335 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45 2018-01-13 17:45:55,335 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:55,335 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45 2018-01-13 17:45:55,336 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:55,337 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-88101289, suffix=, logDir=file:/ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/WALs/hregion-88101289, archiveDir=file:/ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/oldWALs 2018-01-13 17:45:55,343 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/WALs/hregion-88101289/hregion-88101289.1515883555338 2018-01-13 17:45:55,343 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:55,343 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45 Table name == foobar 2018-01-13 17:45:55,403 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883555335.d6a4850d9f2c624a269a7b45f09234b7. 2018-01-13 17:45:55,422 DEBUG [StoreOpener-d6a4850d9f2c624a269a7b45f09234b7-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,423 INFO [StoreOpener-d6a4850d9f2c624a269a7b45f09234b7-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,423 INFO [StoreOpener-d6a4850d9f2c624a269a7b45f09234b7-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,423 INFO [StoreOpener-d6a4850d9f2c624a269a7b45f09234b7-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,424 INFO [StoreOpener-d6a4850d9f2c624a269a7b45f09234b7-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,424 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883555335.d6a4850d9f2c624a269a7b45f09234b7. 2018-01-13 17:45:55,424 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/data/default/foobar/d6a4850d9f2c624a269a7b45f09234b7 2018-01-13 17:45:55,425 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:55,458 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/data/default/foobar/d6a4850d9f2c624a269a7b45f09234b7/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:55,458 INFO [Time-limited test] regionserver.HRegion(960): Onlined d6a4850d9f2c624a269a7b45f09234b7; next sequenceid=2 2018-01-13 17:45:55,458 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,459 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,459 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,459 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,460 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,498 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,500 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883555335.d6a4850d9f2c624a269a7b45f09234b7.store: column 2018-01-13 17:45:55,500 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:55,500 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:55,501 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883555335.d6a4850d9f2c624a269a7b45f09234b7.store: column 2018-01-13 17:45:55,501 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:55,502 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:55,562 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testUpdateToTimeOfOldestEdit[0] Thread=32 (was 30) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/18c9a6cf-46de-4770-83e9-3682aa0a8a45/WALs/hregion-88101289/hregion-88101289.1515883555338 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=276 (was 271) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2365 (was 2374) 2018-01-13 17:45:55,595 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testUpsertMemstoreSize[0] Thread=32, OpenFileDescriptor=278, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2364 2018-01-13 17:45:55,644 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:55,644 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:55,644 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2 2018-01-13 17:45:55,644 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2 2018-01-13 17:45:55,644 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:55,644 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2 2018-01-13 17:45:55,645 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:55,647 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-59561479, suffix=, logDir=file:/ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/WALs/hregion-59561479, archiveDir=file:/ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/oldWALs 2018-01-13 17:45:55,700 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/WALs/hregion-59561479/hregion-59561479.1515883555647 2018-01-13 17:45:55,700 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:55,701 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2 Table name == foobar 2018-01-13 17:45:55,709 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883555645.6bc67207b584685b0e9b83c2fbc8682d. 2018-01-13 17:45:55,712 DEBUG [StoreOpener-6bc67207b584685b0e9b83c2fbc8682d-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,713 INFO [StoreOpener-6bc67207b584685b0e9b83c2fbc8682d-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,714 INFO [StoreOpener-6bc67207b584685b0e9b83c2fbc8682d-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,714 INFO [StoreOpener-6bc67207b584685b0e9b83c2fbc8682d-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,715 INFO [StoreOpener-6bc67207b584685b0e9b83c2fbc8682d-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,716 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883555645.6bc67207b584685b0e9b83c2fbc8682d. 2018-01-13 17:45:55,716 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/data/default/foobar/6bc67207b584685b0e9b83c2fbc8682d 2018-01-13 17:45:55,717 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:55,722 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/data/default/foobar/6bc67207b584685b0e9b83c2fbc8682d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:55,723 INFO [Time-limited test] regionserver.HRegion(960): Onlined 6bc67207b584685b0e9b83c2fbc8682d; next sequenceid=2 2018-01-13 17:45:55,723 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,723 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,723 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,724 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,724 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,756 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,769 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testUpsertMemstoreSize[0] Thread=34 (was 32) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/84d498c0-4c38-4b20-92c8-bc3a620632e2/WALs/hregion-59561479/hregion-59561479.1515883555647 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=281 (was 278) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2343 (was 2364) 2018-01-13 17:45:55,792 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction2Buckets[0] Thread=34, OpenFileDescriptor=281, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2343 2018-01-13 17:45:55,826 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:55,826 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:55,826 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426 2018-01-13 17:45:55,826 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426 2018-01-13 17:45:55,826 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:55,827 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426 2018-01-13 17:45:55,828 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:55,830 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-36744500, suffix=, logDir=file:/ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/WALs/hregion-36744500, archiveDir=file:/ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/oldWALs 2018-01-13 17:45:55,838 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/WALs/hregion-36744500/hregion-36744500.1515883555830 2018-01-13 17:45:55,838 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:55,838 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426 Table name == foobar 2018-01-13 17:45:55,848 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883555827.e72adb244bb98a67a8d1f58cfd7ab74a. 2018-01-13 17:45:55,862 DEBUG [StoreOpener-e72adb244bb98a67a8d1f58cfd7ab74a-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,863 INFO [StoreOpener-e72adb244bb98a67a8d1f58cfd7ab74a-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,863 INFO [StoreOpener-e72adb244bb98a67a8d1f58cfd7ab74a-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,863 INFO [StoreOpener-e72adb244bb98a67a8d1f58cfd7ab74a-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,869 INFO [StoreOpener-e72adb244bb98a67a8d1f58cfd7ab74a-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,870 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883555827.e72adb244bb98a67a8d1f58cfd7ab74a. 2018-01-13 17:45:55,870 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/data/default/foobar/e72adb244bb98a67a8d1f58cfd7ab74a 2018-01-13 17:45:55,870 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:55,877 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/data/default/foobar/e72adb244bb98a67a8d1f58cfd7ab74a/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:55,878 INFO [Time-limited test] regionserver.HRegion(960): Onlined e72adb244bb98a67a8d1f58cfd7ab74a; next sequenceid=2 2018-01-13 17:45:55,878 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:55,878 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,879 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:55,879 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:55,879 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:55,913 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:55,930 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3lM\x04, timestamp1515883555917 2018-01-13 17:45:55,932 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3lZ\x04, timestamp1515883555930 2018-01-13 17:45:55,933 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3l\x5C\x04, timestamp1515883555932 2018-01-13 17:45:55,935 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3l]\x04, timestamp1515883555933 2018-01-13 17:45:55,935 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:55,935 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:55,937 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=432, min timestamp=1515883555930, max timestamp=1515883555933Num uniques 4; 2018-01-13 17:45:55,937 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=432 2018-01-13 17:45:55,938 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3la\x04, timestamp1515883555937 2018-01-13 17:45:55,940 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3lb\x04, timestamp1515883555938 2018-01-13 17:45:55,942 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3ld\x04, timestamp1515883555940 2018-01-13 17:45:55,942 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:55,942 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 2 segments 2018-01-13 17:45:55,944 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=504, min timestamp=1515883555933, max timestamp=1515883555940Num uniques 6; 2018-01-13 17:45:55,944 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=276, new segment data size=184, suffix heap size=1008,new segment heap size=504 2018-01-13 17:45:55,944 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883555827.e72adb244bb98a67a8d1f58cfd7ab74a.store: column 2018-01-13 17:45:55,944 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:55,963 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction2Buckets[0] Thread=36 (was 34) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/c8d2f9cf-d7b8-4f5b-844a-03d481b8d426/WALs/hregion-36744500/hregion-36744500.1515883555830 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=286 (was 281) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2340 (was 2343) 2018-01-13 17:45:55,987 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningPipelineScanner[0] Thread=36, OpenFileDescriptor=286, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2340 2018-01-13 17:45:56,013 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,013 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,013 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da 2018-01-13 17:45:56,013 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da 2018-01-13 17:45:56,014 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,014 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da 2018-01-13 17:45:56,015 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,018 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-18588586, suffix=, logDir=file:/ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/WALs/hregion-18588586, archiveDir=file:/ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/oldWALs 2018-01-13 17:45:56,025 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/WALs/hregion-18588586/hregion-18588586.1515883556019 2018-01-13 17:45:56,025 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,025 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da Table name == foobar 2018-01-13 17:45:56,032 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556014.5e3d61335c710d722cab899e31355f48. 2018-01-13 17:45:56,033 DEBUG [StoreOpener-5e3d61335c710d722cab899e31355f48-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,034 INFO [StoreOpener-5e3d61335c710d722cab899e31355f48-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,034 INFO [StoreOpener-5e3d61335c710d722cab899e31355f48-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,034 INFO [StoreOpener-5e3d61335c710d722cab899e31355f48-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,035 INFO [StoreOpener-5e3d61335c710d722cab899e31355f48-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,035 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556014.5e3d61335c710d722cab899e31355f48. 2018-01-13 17:45:56,035 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/data/default/foobar/5e3d61335c710d722cab899e31355f48 2018-01-13 17:45:56,036 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,041 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/data/default/foobar/5e3d61335c710d722cab899e31355f48/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,041 INFO [Time-limited test] regionserver.HRegion(960): Onlined 5e3d61335c710d722cab899e31355f48; next sequenceid=2 2018-01-13 17:45:56,041 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,042 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,043 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,043 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,044 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,081 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,084 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,084 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store CF_TEST compacting 2 segments 2018-01-13 17:45:56,087 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=174, totalHeapSize=480, min timestamp=1, max timestamp=2Num uniques 5; 2018-01-13 17:45:56,087 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883556014.5e3d61335c710d722cab899e31355f48.) memstoreSize to a negative value which is incorrect. Current memstoreSize=0, delta=-116 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.testPuttingBackChunksWithOpeningPipelineScanner(TestCompactingMemStore.java:532) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,088 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=290, new segment data size=174, suffix heap size=1112,new segment heap size=480 2018-01-13 17:45:56,089 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556014.5e3d61335c710d722cab899e31355f48.store: column 2018-01-13 17:45:56,089 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=null 2018-01-13 17:45:56,089 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556014.5e3d61335c710d722cab899e31355f48.store: column 2018-01-13 17:45:56,090 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=0, new segement=null 2018-01-13 17:45:56,108 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningPipelineScanner[0] Thread=39 (was 36) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/e37c6b74-f0ca-492f-8074-1aeddd0dd6da/WALs/hregion-18588586/hregion-18588586.1515883556019 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=291 (was 286) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2327 (was 2340) 2018-01-13 17:45:56,128 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testSnapshotting[0] Thread=38, OpenFileDescriptor=291, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2324 2018-01-13 17:45:56,146 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,146 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,147 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263 2018-01-13 17:45:56,147 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263 2018-01-13 17:45:56,147 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,147 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263 2018-01-13 17:45:56,148 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,150 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-17540746, suffix=, logDir=file:/ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/WALs/hregion-17540746, archiveDir=file:/ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/oldWALs 2018-01-13 17:45:56,164 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/WALs/hregion-17540746/hregion-17540746.1515883556150 2018-01-13 17:45:56,164 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,164 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263 Table name == foobar 2018-01-13 17:45:56,174 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18. 2018-01-13 17:45:56,177 DEBUG [StoreOpener-bf1a5dc6ff8ed3a535caff6b385ffe18-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,177 INFO [StoreOpener-bf1a5dc6ff8ed3a535caff6b385ffe18-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,178 INFO [StoreOpener-bf1a5dc6ff8ed3a535caff6b385ffe18-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,178 INFO [StoreOpener-bf1a5dc6ff8ed3a535caff6b385ffe18-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,178 INFO [StoreOpener-bf1a5dc6ff8ed3a535caff6b385ffe18-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,179 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18. 2018-01-13 17:45:56,179 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/data/default/foobar/bf1a5dc6ff8ed3a535caff6b385ffe18 2018-01-13 17:45:56,180 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,198 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/data/default/foobar/bf1a5dc6ff8ed3a535caff6b385ffe18/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,198 INFO [Time-limited test] regionserver.HRegion(960): Onlined bf1a5dc6ff8ed3a535caff6b385ffe18; next sequenceid=2 2018-01-13 17:45:56,199 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,199 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,199 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,199 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,200 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,227 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,232 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18.store: column 2018-01-13 17:45:56,232 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,232 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:56,234 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18.store: column 2018-01-13 17:45:56,235 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,235 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:56,238 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18.store: column 2018-01-13 17:45:56,238 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,238 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:56,240 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18.store: column 2018-01-13 17:45:56,241 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,241 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:56,243 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556147.bf1a5dc6ff8ed3a535caff6b385ffe18.store: column 2018-01-13 17:45:56,243 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,243 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:56,256 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testSnapshotting[0] Thread=40 (was 38) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/e37e9976-1dba-453e-972e-f70a6cde9263/WALs/hregion-17540746/hregion-17540746.1515883556150 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=296 (was 291) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2309 (was 2324) 2018-01-13 17:45:56,273 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGet_memstoreAndSnapShot[0] Thread=40, OpenFileDescriptor=298, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2309 2018-01-13 17:45:56,293 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,293 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,294 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d 2018-01-13 17:45:56,294 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d 2018-01-13 17:45:56,294 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,294 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d 2018-01-13 17:45:56,295 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,296 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-66147991, suffix=, logDir=file:/ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/WALs/hregion-66147991, archiveDir=file:/ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/oldWALs 2018-01-13 17:45:56,302 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/WALs/hregion-66147991/hregion-66147991.1515883556297 2018-01-13 17:45:56,302 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,302 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d Table name == foobar 2018-01-13 17:45:56,308 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556294.1e586f2aa3769865f6708f10d4436083. 2018-01-13 17:45:56,309 DEBUG [StoreOpener-1e586f2aa3769865f6708f10d4436083-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,315 INFO [StoreOpener-1e586f2aa3769865f6708f10d4436083-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,315 INFO [StoreOpener-1e586f2aa3769865f6708f10d4436083-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,315 INFO [StoreOpener-1e586f2aa3769865f6708f10d4436083-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,318 INFO [StoreOpener-1e586f2aa3769865f6708f10d4436083-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,321 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556294.1e586f2aa3769865f6708f10d4436083. 2018-01-13 17:45:56,321 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/data/default/foobar/1e586f2aa3769865f6708f10d4436083 2018-01-13 17:45:56,321 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,330 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/data/default/foobar/1e586f2aa3769865f6708f10d4436083/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,330 INFO [Time-limited test] regionserver.HRegion(960): Onlined 1e586f2aa3769865f6708f10d4436083; next sequenceid=2 2018-01-13 17:45:56,330 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,331 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,331 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,331 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,333 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,354 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,355 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,356 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:56,358 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=174, totalHeapSize=480, min timestamp=9223372036854775807, max timestamp=9223372036854775807Num uniques 3; 2018-01-13 17:45:56,359 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=174, new segment data size=174, suffix heap size=624,new segment heap size=480 2018-01-13 17:45:56,359 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556294.1e586f2aa3769865f6708f10d4436083.store: column 2018-01-13 17:45:56,359 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,372 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGet_memstoreAndSnapShot[0] Thread=43 (was 40) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/81c0af4b-d163-4662-993d-0519c34ca77d/WALs/hregion-66147991/hregion-66147991.1515883556297 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=301 (was 298) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2293 (was 2309) 2018-01-13 17:45:56,384 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction1Bucket[0] Thread=42, OpenFileDescriptor=303, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2291 2018-01-13 17:45:56,414 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,414 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,414 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4 2018-01-13 17:45:56,415 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4 2018-01-13 17:45:56,415 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,415 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4 2018-01-13 17:45:56,416 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,417 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-80551818, suffix=, logDir=file:/ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/WALs/hregion-80551818, archiveDir=file:/ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/oldWALs 2018-01-13 17:45:56,423 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/WALs/hregion-80551818/hregion-80551818.1515883556418 2018-01-13 17:45:56,423 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,424 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4 Table name == foobar 2018-01-13 17:45:56,430 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556415.51831a36db205bf5cb62bd913290d2b2. 2018-01-13 17:45:56,432 DEBUG [StoreOpener-51831a36db205bf5cb62bd913290d2b2-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,432 INFO [StoreOpener-51831a36db205bf5cb62bd913290d2b2-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,432 INFO [StoreOpener-51831a36db205bf5cb62bd913290d2b2-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,433 INFO [StoreOpener-51831a36db205bf5cb62bd913290d2b2-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,433 INFO [StoreOpener-51831a36db205bf5cb62bd913290d2b2-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,434 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556415.51831a36db205bf5cb62bd913290d2b2. 2018-01-13 17:45:56,434 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/data/default/foobar/51831a36db205bf5cb62bd913290d2b2 2018-01-13 17:45:56,438 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,445 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/data/default/foobar/51831a36db205bf5cb62bd913290d2b2/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,445 INFO [Time-limited test] regionserver.HRegion(960): Onlined 51831a36db205bf5cb62bd913290d2b2; next sequenceid=2 2018-01-13 17:45:56,445 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,446 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,446 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,446 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,447 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,481 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,484 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3n\x81\x04, timestamp1515883556481 2018-01-13 17:45:56,486 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3n\x84\x04, timestamp1515883556484 2018-01-13 17:45:56,487 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3n\x86\x04, timestamp1515883556486 2018-01-13 17:45:56,489 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3n\x88\x04, timestamp1515883556488 2018-01-13 17:45:56,489 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,489 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:56,493 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=432, min timestamp=1515883556484, max timestamp=1515883556488Num uniques 4; 2018-01-13 17:45:56,493 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=432 2018-01-13 17:45:56,494 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556415.51831a36db205bf5cb62bd913290d2b2.store: column 2018-01-13 17:45:56,494 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,507 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction1Bucket[0] Thread=44 (was 42) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/286dccda-5d11-4402-a4bb-e679a20581a4/WALs/hregion-80551818/hregion-80551818.1515883556418 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=306 (was 303) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2256 (was 2291) 2018-01-13 17:45:56,526 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMagicCompaction3Buckets[0] Thread=44, OpenFileDescriptor=306, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2249 2018-01-13 17:45:56,546 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,546 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,547 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88 2018-01-13 17:45:56,547 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88 2018-01-13 17:45:56,547 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,547 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88 2018-01-13 17:45:56,548 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,555 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-69008554, suffix=, logDir=file:/ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88/WALs/hregion-69008554, archiveDir=file:/ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88/oldWALs 2018-01-13 17:45:56,566 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88/WALs/hregion-69008554/hregion-69008554.1515883556556 2018-01-13 17:45:56,566 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,567 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88 Table name == foobar 2018-01-13 17:45:56,574 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556547.16f8e1d38f1e5514c883e150e9b6821f. 2018-01-13 17:45:56,584 DEBUG [StoreOpener-16f8e1d38f1e5514c883e150e9b6821f-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,584 INFO [StoreOpener-16f8e1d38f1e5514c883e150e9b6821f-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,585 INFO [StoreOpener-16f8e1d38f1e5514c883e150e9b6821f-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,585 INFO [StoreOpener-16f8e1d38f1e5514c883e150e9b6821f-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,585 INFO [StoreOpener-16f8e1d38f1e5514c883e150e9b6821f-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,590 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556547.16f8e1d38f1e5514c883e150e9b6821f. 2018-01-13 17:45:56,590 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88/data/default/foobar/16f8e1d38f1e5514c883e150e9b6821f 2018-01-13 17:45:56,591 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,598 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/0223002c-ea3e-4a29-a451-4242e7dcaa88/data/default/foobar/16f8e1d38f1e5514c883e150e9b6821f/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,598 INFO [Time-limited test] regionserver.HRegion(960): Onlined 16f8e1d38f1e5514c883e150e9b6821f; next sequenceid=2 2018-01-13 17:45:56,598 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,599 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,599 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,600 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,600 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,626 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,629 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o\x12\x04, timestamp:1515883556626 2018-01-13 17:45:56,630 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o\x15\x04, timestamp:1515883556629 2018-01-13 17:45:56,631 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o\x16\x04, timestamp:1515883556630 2018-01-13 17:45:56,631 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,632 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:56,633 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=576, min timestamp=1515883556626, max timestamp=1515883556630Num uniques -1; flattened 2018-01-13 17:45:56,635 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o\x19\x04, timestamp:1515883556633 2018-01-13 17:45:56,636 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,636 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:56,637 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=1, cellSize=46, totalHeapSize=336, min timestamp=1515883556633, max timestamp=1515883556633Num uniques -1; flattened 2018-01-13 17:45:56,703 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o\x1D\x04, timestamp:1515883556637 2018-01-13 17:45:56,704 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o_\x04, timestamp:1515883556703 2018-01-13 17:45:56,705 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3o`\x04, timestamp:1515883556704 2018-01-13 17:45:56,706 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3oa\x04, timestamp:1515883556705 2018-01-13 17:45:56,707 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,707 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(88): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; merging 3 segments 2018-01-13 17:45:56,710 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=8, cellSize=368, totalHeapSize=792, min timestamp=1515883556626, max timestamp=1515883556705Num uniques 4; 2018-01-13 17:45:56,710 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=368, new segment data size=368, suffix heap size=1400,new segment heap size=792 2018-01-13 17:45:56,719 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3of\x04, timestamp:1515883556710 2018-01-13 17:45:56,722 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3oo\x04, timestamp:1515883556719 2018-01-13 17:45:56,724 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3os\x04, timestamp:1515883556723 2018-01-13 17:45:56,724 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,725 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:45:56,726 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=576, min timestamp=1515883556710, max timestamp=1515883556723Num uniques -1; flattened 2018-01-13 17:45:56,726 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556547.16f8e1d38f1e5514c883e150e9b6821f.store: column 2018-01-13 17:45:56,726 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=null 2018-01-13 17:45:56,744 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMagicCompaction3Buckets[0] Thread=37 (was 44), OpenFileDescriptor=293 (was 306), MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=201 (was 199) - ProcessCount LEAK? -, AvailableMemoryMB=2336 (was 2249) - AvailableMemoryMB LEAK? - 2018-01-13 17:45:56,761 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction3Buckets[0] Thread=37, OpenFileDescriptor=293, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2333 2018-01-13 17:45:56,785 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,785 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,785 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1 2018-01-13 17:45:56,786 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1 2018-01-13 17:45:56,786 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,786 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1 2018-01-13 17:45:56,787 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,788 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-87601462, suffix=, logDir=file:/ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/WALs/hregion-87601462, archiveDir=file:/ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/oldWALs 2018-01-13 17:45:56,809 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/WALs/hregion-87601462/hregion-87601462.1515883556788 2018-01-13 17:45:56,809 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,809 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1 Table name == foobar 2018-01-13 17:45:56,822 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556786.290a7588485d211b33bd0693df395eb4. 2018-01-13 17:45:56,825 DEBUG [StoreOpener-290a7588485d211b33bd0693df395eb4-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,826 INFO [StoreOpener-290a7588485d211b33bd0693df395eb4-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,827 INFO [StoreOpener-290a7588485d211b33bd0693df395eb4-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,827 INFO [StoreOpener-290a7588485d211b33bd0693df395eb4-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,828 INFO [StoreOpener-290a7588485d211b33bd0693df395eb4-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,829 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556786.290a7588485d211b33bd0693df395eb4. 2018-01-13 17:45:56,830 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/data/default/foobar/290a7588485d211b33bd0693df395eb4 2018-01-13 17:45:56,830 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,849 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/data/default/foobar/290a7588485d211b33bd0693df395eb4/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,849 INFO [Time-limited test] regionserver.HRegion(960): Onlined 290a7588485d211b33bd0693df395eb4; next sequenceid=2 2018-01-13 17:45:56,849 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,850 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,850 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,850 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,850 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,871 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,873 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x08\x04, timestamp1515883556872 2018-01-13 17:45:56,876 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x09\x04, timestamp1515883556873 2018-01-13 17:45:56,881 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x0D\x04, timestamp1515883556877 2018-01-13 17:45:56,883 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x12\x04, timestamp1515883556882 2018-01-13 17:45:56,883 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,883 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:45:56,885 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=432, min timestamp=1515883556873, max timestamp=1515883556882Num uniques 4; 2018-01-13 17:45:56,885 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=432 2018-01-13 17:45:56,886 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x15\x04, timestamp1515883556885 2018-01-13 17:45:56,888 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x17\x04, timestamp1515883556887 2018-01-13 17:45:56,889 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x18\x04, timestamp1515883556888 2018-01-13 17:45:56,891 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x19\x04, timestamp1515883556889 2018-01-13 17:45:56,893 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x1B\x04, timestamp1515883556891 2018-01-13 17:45:56,894 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3p\x1D\x04, timestamp1515883556893 2018-01-13 17:45:56,894 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:45:56,894 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 3 segments 2018-01-13 17:45:56,897 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=504, min timestamp=1515883556882, max timestamp=1515883556893Num uniques 9; 2018-01-13 17:45:56,897 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=414, new segment data size=184, suffix heap size=1584,new segment heap size=504 2018-01-13 17:45:56,897 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556786.290a7588485d211b33bd0693df395eb4.store: column 2018-01-13 17:45:56,897 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:56,921 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction3Buckets[0] Thread=40 (was 37) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/775ac136-b86d-4908-a2c9-d08affed7bf1/WALs/hregion-87601462/hregion-87601462.1515883556788 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=298 (was 293) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2305 (was 2333) 2018-01-13 17:45:56,933 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot2[0] Thread=39, OpenFileDescriptor=300, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2304 2018-01-13 17:45:56,953 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:56,954 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:56,954 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a 2018-01-13 17:45:56,954 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a 2018-01-13 17:45:56,954 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:56,954 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a 2018-01-13 17:45:56,955 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:56,956 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-10960641, suffix=, logDir=file:/ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/WALs/hregion-10960641, archiveDir=file:/ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/oldWALs 2018-01-13 17:45:56,963 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/WALs/hregion-10960641/hregion-10960641.1515883556957 2018-01-13 17:45:56,963 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:56,963 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a Table name == foobar 2018-01-13 17:45:56,978 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883556954.fa348fe5267e456cd6c388e92a8abd88. 2018-01-13 17:45:56,982 DEBUG [StoreOpener-fa348fe5267e456cd6c388e92a8abd88-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,983 INFO [StoreOpener-fa348fe5267e456cd6c388e92a8abd88-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,983 INFO [StoreOpener-fa348fe5267e456cd6c388e92a8abd88-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,984 INFO [StoreOpener-fa348fe5267e456cd6c388e92a8abd88-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,984 INFO [StoreOpener-fa348fe5267e456cd6c388e92a8abd88-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:56,985 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883556954.fa348fe5267e456cd6c388e92a8abd88. 2018-01-13 17:45:56,986 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/data/default/foobar/fa348fe5267e456cd6c388e92a8abd88 2018-01-13 17:45:56,986 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:56,996 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/data/default/foobar/fa348fe5267e456cd6c388e92a8abd88/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:56,997 INFO [Time-limited test] regionserver.HRegion(960): Onlined fa348fe5267e456cd6c388e92a8abd88; next sequenceid=2 2018-01-13 17:45:56,997 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:56,997 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:56,998 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:56,998 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:56,999 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,026 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,029 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556954.fa348fe5267e456cd6c388e92a8abd88.store: column 2018-01-13 17:45:57,029 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:57,069 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,070 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883556954.fa348fe5267e456cd6c388e92a8abd88.store: column 2018-01-13 17:45:57,070 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:57,110 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot2[0] Thread=42 (was 39) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/947c28b4-e3a6-4901-9b2d-134a574aa94a/WALs/hregion-10960641/hregion-10960641.1515883556957 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=303 (was 300) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2277 (was 2304) 2018-01-13 17:45:57,127 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteColumn[0] Thread=41, OpenFileDescriptor=303, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2274 2018-01-13 17:45:57,164 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,164 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,164 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/10cecc35-0b7d-4665-9239-777c326222cb 2018-01-13 17:45:57,165 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/10cecc35-0b7d-4665-9239-777c326222cb 2018-01-13 17:45:57,165 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,165 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/10cecc35-0b7d-4665-9239-777c326222cb 2018-01-13 17:45:57,166 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,168 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-02461315, suffix=, logDir=file:/ram4G/10cecc35-0b7d-4665-9239-777c326222cb/WALs/hregion-02461315, archiveDir=file:/ram4G/10cecc35-0b7d-4665-9239-777c326222cb/oldWALs 2018-01-13 17:45:57,189 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/10cecc35-0b7d-4665-9239-777c326222cb/WALs/hregion-02461315/hregion-02461315.1515883557169 2018-01-13 17:45:57,189 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,189 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/10cecc35-0b7d-4665-9239-777c326222cb Table name == foobar 2018-01-13 17:45:57,219 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557165.b4b39d20ce201538333fa86669cea727. 2018-01-13 17:45:57,222 DEBUG [StoreOpener-b4b39d20ce201538333fa86669cea727-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,223 INFO [StoreOpener-b4b39d20ce201538333fa86669cea727-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,223 INFO [StoreOpener-b4b39d20ce201538333fa86669cea727-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,223 INFO [StoreOpener-b4b39d20ce201538333fa86669cea727-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,224 INFO [StoreOpener-b4b39d20ce201538333fa86669cea727-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,224 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557165.b4b39d20ce201538333fa86669cea727. 2018-01-13 17:45:57,225 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/10cecc35-0b7d-4665-9239-777c326222cb/data/default/foobar/b4b39d20ce201538333fa86669cea727 2018-01-13 17:45:57,225 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,242 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/10cecc35-0b7d-4665-9239-777c326222cb/data/default/foobar/b4b39d20ce201538333fa86669cea727/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,242 INFO [Time-limited test] regionserver.HRegion(960): Onlined b4b39d20ce201538333fa86669cea727; next sequenceid=2 2018-01-13 17:45:57,242 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,243 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,243 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,243 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,243 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,273 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,299 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteColumn[0] Thread=43 (was 41) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/10cecc35-0b7d-4665-9239-777c326222cb/WALs/hregion-02461315/hregion-02461315.1515883557169 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=308 (was 303) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2246 (was 2274) 2018-01-13 17:45:57,311 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteFamily[0] Thread=43, OpenFileDescriptor=310, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2244 2018-01-13 17:45:57,329 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,329 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,329 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9 2018-01-13 17:45:57,329 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9 2018-01-13 17:45:57,329 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,330 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9 2018-01-13 17:45:57,330 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,331 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-12354653, suffix=, logDir=file:/ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/WALs/hregion-12354653, archiveDir=file:/ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/oldWALs 2018-01-13 17:45:57,342 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/WALs/hregion-12354653/hregion-12354653.1515883557332 2018-01-13 17:45:57,343 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,343 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9 Table name == foobar 2018-01-13 17:45:57,350 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557330.7fc96b789962ca40dca2402b72d69ce1. 2018-01-13 17:45:57,352 DEBUG [StoreOpener-7fc96b789962ca40dca2402b72d69ce1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,352 INFO [StoreOpener-7fc96b789962ca40dca2402b72d69ce1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,352 INFO [StoreOpener-7fc96b789962ca40dca2402b72d69ce1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,353 INFO [StoreOpener-7fc96b789962ca40dca2402b72d69ce1-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,353 INFO [StoreOpener-7fc96b789962ca40dca2402b72d69ce1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,353 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557330.7fc96b789962ca40dca2402b72d69ce1. 2018-01-13 17:45:57,354 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/data/default/foobar/7fc96b789962ca40dca2402b72d69ce1 2018-01-13 17:45:57,354 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,360 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/data/default/foobar/7fc96b789962ca40dca2402b72d69ce1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,360 INFO [Time-limited test] regionserver.HRegion(960): Onlined 7fc96b789962ca40dca2402b72d69ce1; next sequenceid=2 2018-01-13 17:45:57,360 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,361 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,361 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,361 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,361 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,390 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,407 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteFamily[0] Thread=46 (was 43) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/86a6903e-668d-4d13-ae3a-634da1e1e4f9/WALs/hregion-12354653/hregion-12354653.1515883557332 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=313 (was 310) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2218 (was 2244) 2018-01-13 17:45:57,420 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlushMeta[0] Thread=45, OpenFileDescriptor=313, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2213 2018-01-13 17:45:57,441 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,442 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,442 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c 2018-01-13 17:45:57,442 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c 2018-01-13 17:45:57,442 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,442 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c 2018-01-13 17:45:57,443 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,444 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-94559194, suffix=, logDir=file:/ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/WALs/hregion-94559194, archiveDir=file:/ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/oldWALs 2018-01-13 17:45:57,471 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/WALs/hregion-94559194/hregion-94559194.1515883557445 2018-01-13 17:45:57,471 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,471 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c Table name == foobar 2018-01-13 17:45:57,475 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557442.fd99606274b2ad612b855953d4589c39. 2018-01-13 17:45:57,476 DEBUG [StoreOpener-fd99606274b2ad612b855953d4589c39-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,477 INFO [StoreOpener-fd99606274b2ad612b855953d4589c39-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,477 INFO [StoreOpener-fd99606274b2ad612b855953d4589c39-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,477 INFO [StoreOpener-fd99606274b2ad612b855953d4589c39-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,477 INFO [StoreOpener-fd99606274b2ad612b855953d4589c39-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,478 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557442.fd99606274b2ad612b855953d4589c39. 2018-01-13 17:45:57,478 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/data/default/foobar/fd99606274b2ad612b855953d4589c39 2018-01-13 17:45:57,479 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,490 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/data/default/foobar/fd99606274b2ad612b855953d4589c39/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,490 INFO [Time-limited test] regionserver.HRegion(960): Onlined fd99606274b2ad612b855953d4589c39; next sequenceid=2 2018-01-13 17:45:57,490 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,491 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,491 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,491 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,491 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,516 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,547 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,548 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,549 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65 2018-01-13 17:45:57,550 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65 2018-01-13 17:45:57,550 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,551 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65 2018-01-13 17:45:57,552 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,558 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,559 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=1234.meta, suffix=.meta, logDir=file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234, archiveDir=file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/oldWALs 2018-01-13 17:45:57,563 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234/1234.meta.1515883557559.meta 2018-01-13 17:45:57,563 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,564 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_barrier', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_meta', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_position', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'table', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65 Table name == hbase:meta 2018-01-13 17:45:57,568 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated hbase:meta,,1.1588230740 2018-01-13 17:45:57,570 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:45:57,571 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:45:57,572 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:45:57,575 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_meta: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,579 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:45:57,581 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_position: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,581 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:45:57,582 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,583 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/data/hbase/meta/1588230740 2018-01-13 17:45:57,583 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushSize/# of families (25,6M)) instead. 2018-01-13 17:45:57,589 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/data/hbase/meta/1588230740/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,589 INFO [Time-limited test] regionserver.HRegion(960): Onlined 1588230740; next sequenceid=2 2018-01-13 17:45:57,595 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=1234, suffix=, logDir=file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234, archiveDir=file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/oldWALs 2018-01-13 17:45:57,606 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234/1234.1515883557596 2018-01-13 17:45:57,607 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,607 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion testShouldFlushMeta_0_ HTD == 'testShouldFlushMeta_0_', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65 Table name == testShouldFlushMeta_0_ 2018-01-13 17:45:57,611 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated testShouldFlushMeta_0_,row_0200,1515883557590.2c06ab7d6d7d86b4edcee722eb58c8b1. 2018-01-13 17:45:57,627 DEBUG [StoreOpener-2c06ab7d6d7d86b4edcee722eb58c8b1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,628 INFO [StoreOpener-2c06ab7d6d7d86b4edcee722eb58c8b1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,628 INFO [StoreOpener-2c06ab7d6d7d86b4edcee722eb58c8b1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,628 INFO [StoreOpener-2c06ab7d6d7d86b4edcee722eb58c8b1-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,629 INFO [StoreOpener-2c06ab7d6d7d86b4edcee722eb58c8b1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,630 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=testShouldFlushMeta_0_,row_0200,1515883557590.2c06ab7d6d7d86b4edcee722eb58c8b1. 2018-01-13 17:45:57,630 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/data/default/testShouldFlushMeta_0_/2c06ab7d6d7d86b4edcee722eb58c8b1 2018-01-13 17:45:57,630 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testShouldFlushMeta_0_ descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,645 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/data/default/testShouldFlushMeta_0_/2c06ab7d6d7d86b4edcee722eb58c8b1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,645 INFO [Time-limited test] regionserver.HRegion(960): Onlined 2c06ab7d6d7d86b4edcee722eb58c8b1; next sequenceid=2 2018-01-13 17:45:57,726 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlushMeta[0] Thread=51 (was 45) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234/1234.1515883557596 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/87ed81c9-5f99-4a97-b253-1de7fef00b65/WALs/1234/1234.meta.1515883557559.meta sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/5a223bdb-34c0-4769-b04e-dbf714ec710c/WALs/hregion-94559194/hregion-94559194.1515883557445 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=328 (was 313) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2157 (was 2213) 2018-01-13 17:45:57,739 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreEditsVisibilityWithSameKey[0] Thread=51, OpenFileDescriptor=328, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2156 2018-01-13 17:45:57,757 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,757 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,757 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/de39028c-dddc-4242-add9-938c90bb2415 2018-01-13 17:45:57,757 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/de39028c-dddc-4242-add9-938c90bb2415 2018-01-13 17:45:57,757 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,757 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/de39028c-dddc-4242-add9-938c90bb2415 2018-01-13 17:45:57,758 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,759 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-13463293, suffix=, logDir=file:/ram4G/de39028c-dddc-4242-add9-938c90bb2415/WALs/hregion-13463293, archiveDir=file:/ram4G/de39028c-dddc-4242-add9-938c90bb2415/oldWALs 2018-01-13 17:45:57,767 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/de39028c-dddc-4242-add9-938c90bb2415/WALs/hregion-13463293/hregion-13463293.1515883557760 2018-01-13 17:45:57,767 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,767 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/de39028c-dddc-4242-add9-938c90bb2415 Table name == foobar 2018-01-13 17:45:57,773 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557758.d26648f0d13fb76368f5367c1d4e3fd8. 2018-01-13 17:45:57,775 DEBUG [StoreOpener-d26648f0d13fb76368f5367c1d4e3fd8-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,775 INFO [StoreOpener-d26648f0d13fb76368f5367c1d4e3fd8-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,776 INFO [StoreOpener-d26648f0d13fb76368f5367c1d4e3fd8-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,776 INFO [StoreOpener-d26648f0d13fb76368f5367c1d4e3fd8-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,776 INFO [StoreOpener-d26648f0d13fb76368f5367c1d4e3fd8-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,777 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557758.d26648f0d13fb76368f5367c1d4e3fd8. 2018-01-13 17:45:57,777 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/de39028c-dddc-4242-add9-938c90bb2415/data/default/foobar/d26648f0d13fb76368f5367c1d4e3fd8 2018-01-13 17:45:57,778 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,786 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/de39028c-dddc-4242-add9-938c90bb2415/data/default/foobar/d26648f0d13fb76368f5367c1d4e3fd8/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,786 INFO [Time-limited test] regionserver.HRegion(960): Onlined d26648f0d13fb76368f5367c1d4e3fd8; next sequenceid=2 2018-01-13 17:45:57,786 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,787 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,787 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,787 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,787 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,814 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,833 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreEditsVisibilityWithSameKey[0] Thread=54 (was 51) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/de39028c-dddc-4242-add9-938c90bb2415/WALs/hregion-13463293/hregion-13463293.1515883557760 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=333 (was 328) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2148 (was 2156) 2018-01-13 17:45:57,845 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testKeepDeleteInmemstore[0] Thread=53, OpenFileDescriptor=333, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2147 2018-01-13 17:45:57,863 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,863 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,863 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565 2018-01-13 17:45:57,864 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565 2018-01-13 17:45:57,864 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,864 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565 2018-01-13 17:45:57,864 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,865 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-84354203, suffix=, logDir=file:/ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/WALs/hregion-84354203, archiveDir=file:/ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/oldWALs 2018-01-13 17:45:57,879 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/WALs/hregion-84354203/hregion-84354203.1515883557866 2018-01-13 17:45:57,879 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,880 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565 Table name == foobar 2018-01-13 17:45:57,892 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557864.2dfd0ea89e4a8445cf1a199ae9a6d303. 2018-01-13 17:45:57,894 DEBUG [StoreOpener-2dfd0ea89e4a8445cf1a199ae9a6d303-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,894 INFO [StoreOpener-2dfd0ea89e4a8445cf1a199ae9a6d303-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,894 INFO [StoreOpener-2dfd0ea89e4a8445cf1a199ae9a6d303-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,895 INFO [StoreOpener-2dfd0ea89e4a8445cf1a199ae9a6d303-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,897 INFO [StoreOpener-2dfd0ea89e4a8445cf1a199ae9a6d303-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,901 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557864.2dfd0ea89e4a8445cf1a199ae9a6d303. 2018-01-13 17:45:57,902 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/data/default/foobar/2dfd0ea89e4a8445cf1a199ae9a6d303 2018-01-13 17:45:57,902 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:57,909 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/data/default/foobar/2dfd0ea89e4a8445cf1a199ae9a6d303/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:57,909 INFO [Time-limited test] regionserver.HRegion(960): Onlined 2dfd0ea89e4a8445cf1a199ae9a6d303; next sequenceid=2 2018-01-13 17:45:57,909 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:57,914 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,914 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:57,914 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:57,915 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:57,936 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:57,951 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testKeepDeleteInmemstore[0] Thread=55 (was 53) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/f9cdc8f0-eb04-4d6e-b44a-070bb5f0f565/WALs/hregion-84354203/hregion-84354203.1515883557866 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=338 (was 333) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2138 (was 2147) 2018-01-13 17:45:57,963 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlush[0] Thread=55, OpenFileDescriptor=338, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2138 2018-01-13 17:45:57,982 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:57,982 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:57,982 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df 2018-01-13 17:45:57,982 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df 2018-01-13 17:45:57,982 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:57,983 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df 2018-01-13 17:45:57,983 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:57,984 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-41309433, suffix=, logDir=file:/ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/WALs/hregion-41309433, archiveDir=file:/ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/oldWALs 2018-01-13 17:45:57,999 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/WALs/hregion-41309433/hregion-41309433.1515883557985 2018-01-13 17:45:57,999 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:57,999 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df Table name == foobar 2018-01-13 17:45:58,026 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883557983.6534f21400ea47d1d27abed0d3288275. 2018-01-13 17:45:58,047 DEBUG [StoreOpener-6534f21400ea47d1d27abed0d3288275-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,048 INFO [StoreOpener-6534f21400ea47d1d27abed0d3288275-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,048 INFO [StoreOpener-6534f21400ea47d1d27abed0d3288275-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,048 INFO [StoreOpener-6534f21400ea47d1d27abed0d3288275-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,048 INFO [StoreOpener-6534f21400ea47d1d27abed0d3288275-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,049 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883557983.6534f21400ea47d1d27abed0d3288275. 2018-01-13 17:45:58,049 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/data/default/foobar/6534f21400ea47d1d27abed0d3288275 2018-01-13 17:45:58,049 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,055 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/data/default/foobar/6534f21400ea47d1d27abed0d3288275/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,055 INFO [Time-limited test] regionserver.HRegion(960): Onlined 6534f21400ea47d1d27abed0d3288275; next sequenceid=2 2018-01-13 17:45:58,055 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,056 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,056 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,056 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,056 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,087 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,109 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,109 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,110 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e 2018-01-13 17:45:58,110 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e 2018-01-13 17:45:58,110 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,110 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e 2018-01-13 17:45:58,113 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,115 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-32285133, suffix=, logDir=file:/ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/WALs/hregion-32285133, archiveDir=file:/ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/oldWALs 2018-01-13 17:45:58,130 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/WALs/hregion-32285133/hregion-32285133.1515883558115 2018-01-13 17:45:58,131 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,132 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e Table name == foobar 2018-01-13 17:45:58,141 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558111.0b94c7e89de4a897020f9fb04b52ea7a. 2018-01-13 17:45:58,142 DEBUG [StoreOpener-0b94c7e89de4a897020f9fb04b52ea7a-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,143 INFO [StoreOpener-0b94c7e89de4a897020f9fb04b52ea7a-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,143 INFO [StoreOpener-0b94c7e89de4a897020f9fb04b52ea7a-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,143 INFO [StoreOpener-0b94c7e89de4a897020f9fb04b52ea7a-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,143 INFO [StoreOpener-0b94c7e89de4a897020f9fb04b52ea7a-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,144 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558111.0b94c7e89de4a897020f9fb04b52ea7a. 2018-01-13 17:45:58,144 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/data/default/foobar/0b94c7e89de4a897020f9fb04b52ea7a 2018-01-13 17:45:58,145 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,150 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/data/default/foobar/0b94c7e89de4a897020f9fb04b52ea7a/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,150 INFO [Time-limited test] regionserver.HRegion(960): Onlined 0b94c7e89de4a897020f9fb04b52ea7a; next sequenceid=2 2018-01-13 17:45:58,152 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc 2018-01-13 17:45:58,152 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc 2018-01-13 17:45:58,153 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc 2018-01-13 17:45:58,153 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,155 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-32703860, suffix=, logDir=file:/ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/WALs/hregion-32703860, archiveDir=file:/ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/oldWALs 2018-01-13 17:45:58,174 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/WALs/hregion-32703860/hregion-32703860.1515883558156 2018-01-13 17:45:58,174 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,174 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc Table name == foobar 2018-01-13 17:45:58,180 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558153.88a5a6066c9eff6b1fc42d2beb23df2e. 2018-01-13 17:45:58,185 DEBUG [StoreOpener-88a5a6066c9eff6b1fc42d2beb23df2e-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,186 INFO [StoreOpener-88a5a6066c9eff6b1fc42d2beb23df2e-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,186 INFO [StoreOpener-88a5a6066c9eff6b1fc42d2beb23df2e-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,186 INFO [StoreOpener-88a5a6066c9eff6b1fc42d2beb23df2e-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,187 INFO [StoreOpener-88a5a6066c9eff6b1fc42d2beb23df2e-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,191 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558153.88a5a6066c9eff6b1fc42d2beb23df2e. 2018-01-13 17:45:58,191 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/data/default/foobar/88a5a6066c9eff6b1fc42d2beb23df2e 2018-01-13 17:45:58,191 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,211 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/data/default/foobar/88a5a6066c9eff6b1fc42d2beb23df2e/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,212 INFO [Time-limited test] regionserver.HRegion(960): Onlined 88a5a6066c9eff6b1fc42d2beb23df2e; next sequenceid=2 2018-01-13 17:45:58,291 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlush[0] Thread=62 (was 55) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/a2f09087-079a-41af-9672-d7ebbcd3fc8e/WALs/hregion-32285133/hregion-32285133.1515883558115 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/98c07b98-eb04-4d5c-acc0-ef30a44553df/WALs/hregion-41309433/hregion-41309433.1515883557985 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/4490a4ed-f45d-4011-a3c4-b9dab9ed94bc/WALs/hregion-32703860/hregion-32703860.1515883558156 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=353 (was 338) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2110 (was 2138) 2018-01-13 17:45:58,314 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDelete[0] Thread=61, OpenFileDescriptor=355, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2108 2018-01-13 17:45:58,361 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,361 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,362 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2 2018-01-13 17:45:58,362 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2 2018-01-13 17:45:58,362 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,362 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2 2018-01-13 17:45:58,363 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,368 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-93514026, suffix=, logDir=file:/ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/WALs/hregion-93514026, archiveDir=file:/ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/oldWALs 2018-01-13 17:45:58,378 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/WALs/hregion-93514026/hregion-93514026.1515883558369 2018-01-13 17:45:58,378 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,379 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2 Table name == foobar 2018-01-13 17:45:58,384 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558362.826bf113b09e61f5a38bf8e2491bc6e1. 2018-01-13 17:45:58,385 DEBUG [StoreOpener-826bf113b09e61f5a38bf8e2491bc6e1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,386 INFO [StoreOpener-826bf113b09e61f5a38bf8e2491bc6e1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,386 INFO [StoreOpener-826bf113b09e61f5a38bf8e2491bc6e1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,386 INFO [StoreOpener-826bf113b09e61f5a38bf8e2491bc6e1-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,386 INFO [StoreOpener-826bf113b09e61f5a38bf8e2491bc6e1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,387 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558362.826bf113b09e61f5a38bf8e2491bc6e1. 2018-01-13 17:45:58,387 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/data/default/foobar/826bf113b09e61f5a38bf8e2491bc6e1 2018-01-13 17:45:58,387 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,394 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/data/default/foobar/826bf113b09e61f5a38bf8e2491bc6e1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,394 INFO [Time-limited test] regionserver.HRegion(960): Onlined 826bf113b09e61f5a38bf8e2491bc6e1; next sequenceid=2 2018-01-13 17:45:58,395 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,395 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,395 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,396 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,396 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,421 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,436 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDelete[0] Thread=63 (was 61) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/1997e592-b080-4171-a0fe-73a75d6fd3f2/WALs/hregion-93514026/hregion-93514026.1515883558369 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=358 (was 355) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2103 (was 2108) 2018-01-13 17:45:58,448 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteColumn[0] Thread=63, OpenFileDescriptor=358, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2103 2018-01-13 17:45:58,473 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,473 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,474 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42 2018-01-13 17:45:58,474 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42 2018-01-13 17:45:58,474 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,474 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42 2018-01-13 17:45:58,475 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,476 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-59378307, suffix=, logDir=file:/ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/WALs/hregion-59378307, archiveDir=file:/ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/oldWALs 2018-01-13 17:45:58,501 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/WALs/hregion-59378307/hregion-59378307.1515883558477 2018-01-13 17:45:58,501 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,501 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42 Table name == foobar 2018-01-13 17:45:58,527 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558474.33da3858f58b326828b21e8f373f01e7. 2018-01-13 17:45:58,529 DEBUG [StoreOpener-33da3858f58b326828b21e8f373f01e7-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,529 INFO [StoreOpener-33da3858f58b326828b21e8f373f01e7-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,529 INFO [StoreOpener-33da3858f58b326828b21e8f373f01e7-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,530 INFO [StoreOpener-33da3858f58b326828b21e8f373f01e7-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,530 INFO [StoreOpener-33da3858f58b326828b21e8f373f01e7-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,531 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558474.33da3858f58b326828b21e8f373f01e7. 2018-01-13 17:45:58,531 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/data/default/foobar/33da3858f58b326828b21e8f373f01e7 2018-01-13 17:45:58,531 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,535 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/data/default/foobar/33da3858f58b326828b21e8f373f01e7/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,535 INFO [Time-limited test] regionserver.HRegion(960): Onlined 33da3858f58b326828b21e8f373f01e7; next sequenceid=2 2018-01-13 17:45:58,535 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,536 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,536 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,536 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,536 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,595 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,607 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteColumn[0] Thread=66 (was 63) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/fe9a77c9-1135-41fe-8faf-b3f968d56a42/WALs/hregion-59378307/hregion-59378307.1515883558477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=363 (was 358) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2094 (was 2103) 2018-01-13 17:45:58,623 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteFamily[0] Thread=65, OpenFileDescriptor=363, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2092 2018-01-13 17:45:58,643 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,643 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,643 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d 2018-01-13 17:45:58,643 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d 2018-01-13 17:45:58,643 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,643 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d 2018-01-13 17:45:58,644 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,645 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-61732389, suffix=, logDir=file:/ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/WALs/hregion-61732389, archiveDir=file:/ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/oldWALs 2018-01-13 17:45:58,651 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/WALs/hregion-61732389/hregion-61732389.1515883558646 2018-01-13 17:45:58,651 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,652 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d Table name == foobar 2018-01-13 17:45:58,663 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558644.4666e035553537299b44376ad768439f. 2018-01-13 17:45:58,665 DEBUG [StoreOpener-4666e035553537299b44376ad768439f-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,666 INFO [StoreOpener-4666e035553537299b44376ad768439f-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,666 INFO [StoreOpener-4666e035553537299b44376ad768439f-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,666 INFO [StoreOpener-4666e035553537299b44376ad768439f-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,666 INFO [StoreOpener-4666e035553537299b44376ad768439f-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,667 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558644.4666e035553537299b44376ad768439f. 2018-01-13 17:45:58,667 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/data/default/foobar/4666e035553537299b44376ad768439f 2018-01-13 17:45:58,667 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,672 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/data/default/foobar/4666e035553537299b44376ad768439f/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,673 INFO [Time-limited test] regionserver.HRegion(960): Onlined 4666e035553537299b44376ad768439f; next sequenceid=2 2018-01-13 17:45:58,673 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,674 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,674 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,674 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,675 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,698 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,710 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteFamily[0] Thread=67 (was 65) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/ea935232-da1d-4db1-bcfe-8b76a788064d/WALs/hregion-61732389/hregion-61732389.1515883558646 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=368 (was 363) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=2077 (was 2092) 2018-01-13 17:45:58,722 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot[0] Thread=67, OpenFileDescriptor=368, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=201, AvailableMemoryMB=2074 2018-01-13 17:45:58,751 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,751 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,751 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d 2018-01-13 17:45:58,752 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d 2018-01-13 17:45:58,752 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,752 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d 2018-01-13 17:45:58,753 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,754 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-18099363, suffix=, logDir=file:/ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/WALs/hregion-18099363, archiveDir=file:/ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/oldWALs 2018-01-13 17:45:58,761 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/WALs/hregion-18099363/hregion-18099363.1515883558755 2018-01-13 17:45:58,761 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,762 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d Table name == foobar 2018-01-13 17:45:58,769 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558752.36ff903308b25bb7bc96bec9a200f7d8. 2018-01-13 17:45:58,770 DEBUG [StoreOpener-36ff903308b25bb7bc96bec9a200f7d8-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,770 INFO [StoreOpener-36ff903308b25bb7bc96bec9a200f7d8-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,771 INFO [StoreOpener-36ff903308b25bb7bc96bec9a200f7d8-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,771 INFO [StoreOpener-36ff903308b25bb7bc96bec9a200f7d8-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,771 INFO [StoreOpener-36ff903308b25bb7bc96bec9a200f7d8-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,772 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558752.36ff903308b25bb7bc96bec9a200f7d8. 2018-01-13 17:45:58,772 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/data/default/foobar/36ff903308b25bb7bc96bec9a200f7d8 2018-01-13 17:45:58,772 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,777 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/data/default/foobar/36ff903308b25bb7bc96bec9a200f7d8/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,777 INFO [Time-limited test] regionserver.HRegion(960): Onlined 36ff903308b25bb7bc96bec9a200f7d8; next sequenceid=2 2018-01-13 17:45:58,777 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,778 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,778 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,778 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,779 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,805 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,837 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x00/column:0;0/1515883558805/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883558805/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883558805/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883558805/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883558805/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883558805/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883558805/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883558805/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883558805/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883558805/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:45:58,837 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x01/column:1;0/1515883558806/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883558806/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883558806/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883558806/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883558806/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883558806/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883558806/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883558806/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883558806/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883558806/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:45:58,838 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x02/column:2;0/1515883558807/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883558807/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883558807/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883558807/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883558807/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883558807/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883558807/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883558807/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883558807/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883558807/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:45:58,838 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x03/column:3;0/1515883558807/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883558807/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883558807/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883558807/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883558807/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883558807/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883558807/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883558807/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883558807/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883558807/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:45:58,838 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x04/column:4;0/1515883558807/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883558807/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883558807/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883558807/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883558807/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883558807/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883558807/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883558807/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883558807/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883558807/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:45:58,839 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x05/column:5;0/1515883558807/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883558807/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883558807/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883558807/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883558807/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883558807/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883558807/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883558807/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883558807/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883558807/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:45:58,839 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x06/column:6;0/1515883558807/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883558807/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883558807/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883558807/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883558807/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883558807/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883558807/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883558807/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883558807/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883558807/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:45:58,840 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x07/column:7;0/1515883558807/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883558807/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883558807/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883558807/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883558807/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883558807/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883558807/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883558807/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883558807/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883558807/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:45:58,840 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x08/column:8;0/1515883558807/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883558807/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883558807/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883558807/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883558807/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883558807/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883558807/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883558807/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883558807/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883558807/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:45:58,841 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x09/column:9;0/1515883558807/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883558807/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883558807/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883558807/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883558807/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883558807/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883558807/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883558807/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883558807/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883558807/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:45:58,841 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x00/column:0;0/1515883558805/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883558805/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883558805/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883558805/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883558805/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883558805/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883558805/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883558805/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883558805/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883558805/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:45:58,847 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x01/column:1;0/1515883558806/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883558806/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883558806/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883558806/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883558806/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883558806/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883558806/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883558806/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883558806/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883558806/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:45:58,847 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883558752.36ff903308b25bb7bc96bec9a200f7d8.store: column 2018-01-13 17:45:58,847 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:45:58,847 INFO [Time-limited test] regionserver.TestDefaultMemStore(195): Snapshotted 2018-01-13 17:45:58,848 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x02/column:2;0/1515883558807/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883558807/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883558807/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883558807/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883558807/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883558807/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883558807/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883558807/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883558807/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883558807/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:45:58,848 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x03/column:3;0/1515883558807/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883558807/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883558807/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883558807/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883558807/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883558807/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883558807/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883558807/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883558807/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883558807/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:45:58,849 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x04/column:4;0/1515883558807/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883558807/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883558807/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883558807/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883558807/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883558807/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883558807/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883558807/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883558807/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883558807/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:45:58,849 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x05/column:5;0/1515883558807/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883558807/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883558807/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883558807/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883558807/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883558807/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883558807/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883558807/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883558807/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883558807/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:45:58,850 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x06/column:6;0/1515883558807/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883558807/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883558807/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883558807/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883558807/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883558807/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883558807/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883558807/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883558807/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883558807/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:45:58,850 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x07/column:7;0/1515883558807/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883558807/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883558807/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883558807/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883558807/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883558807/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883558807/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883558807/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883558807/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883558807/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:45:58,850 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x08/column:8;0/1515883558807/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883558807/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883558807/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883558807/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883558807/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883558807/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883558807/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883558807/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883558807/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883558807/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:45:58,851 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x09/column:9;0/1515883558807/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883558807/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883558807/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883558807/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883558807/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883558807/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883558807/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883558807/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883558807/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883558807/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:45:58,851 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x00/column:0;0/1515883558805/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883558805/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883558805/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883558805/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883558805/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883558805/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883558805/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883558805/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883558805/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883558805/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:45:58,852 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x01/column:1;0/1515883558806/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883558806/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883558806/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883558806/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883558806/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883558806/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883558806/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883558806/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883558806/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883558806/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:45:58,853 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x02/column:2;0/1515883558807/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883558807/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883558807/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883558807/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883558807/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883558807/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883558807/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883558807/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883558807/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883558807/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:45:58,853 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x03/column:3;0/1515883558807/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883558807/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883558807/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883558807/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883558807/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883558807/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883558807/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883558807/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883558807/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883558807/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:45:58,854 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x04/column:4;0/1515883558807/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883558807/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883558807/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883558807/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883558807/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883558807/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883558807/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883558807/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883558807/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883558807/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:45:58,854 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:45:58,856 INFO [Time-limited test] regionserver.TestDefaultMemStore(222): Snapshotted, cleared it and then added values (which wont be seen) 2018-01-13 17:45:58,856 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x05/column:5;0/1515883558807/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883558807/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883558807/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883558807/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883558807/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883558807/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883558807/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883558807/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883558807/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883558807/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:45:58,857 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x06/column:6;0/1515883558807/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883558807/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883558807/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883558807/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883558807/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883558807/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883558807/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883558807/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883558807/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883558807/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:45:58,857 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x07/column:7;0/1515883558807/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883558807/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883558807/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883558807/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883558807/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883558807/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883558807/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883558807/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883558807/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883558807/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:45:58,858 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x08/column:8;0/1515883558807/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883558807/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883558807/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883558807/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883558807/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883558807/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883558807/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883558807/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883558807/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883558807/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:45:58,858 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x09/column:9;0/1515883558807/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883558807/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883558807/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883558807/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883558807/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883558807/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883558807/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883558807/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883558807/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883558807/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:45:58,887 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot[0] Thread=70 (was 67) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/cd298051-0627-4ff4-926e-8dcb81d0c61d/WALs/hregion-18099363/hregion-18099363.1515883558755 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=373 (was 368) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 201), AvailableMemoryMB=2028 (was 2074) 2018-01-13 17:45:58,900 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreConcurrentControl[0] Thread=69, OpenFileDescriptor=375, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=2027 2018-01-13 17:45:58,918 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:58,918 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:58,918 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491 2018-01-13 17:45:58,918 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491 2018-01-13 17:45:58,918 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:58,919 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491 2018-01-13 17:45:58,919 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:58,920 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-06009951, suffix=, logDir=file:/ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491/WALs/hregion-06009951, archiveDir=file:/ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491/oldWALs 2018-01-13 17:45:58,927 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491/WALs/hregion-06009951/hregion-06009951.1515883558921 2018-01-13 17:45:58,927 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:58,927 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491 Table name == foobar 2018-01-13 17:45:58,931 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883558919.abb5bed74a83e92119d39be5107ac1f2. 2018-01-13 17:45:58,932 DEBUG [StoreOpener-abb5bed74a83e92119d39be5107ac1f2-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,933 INFO [StoreOpener-abb5bed74a83e92119d39be5107ac1f2-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,933 INFO [StoreOpener-abb5bed74a83e92119d39be5107ac1f2-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,933 INFO [StoreOpener-abb5bed74a83e92119d39be5107ac1f2-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,933 INFO [StoreOpener-abb5bed74a83e92119d39be5107ac1f2-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,934 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883558919.abb5bed74a83e92119d39be5107ac1f2. 2018-01-13 17:45:58,934 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491/data/default/foobar/abb5bed74a83e92119d39be5107ac1f2 2018-01-13 17:45:58,934 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:58,938 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/2cca62c8-0d72-420c-b827-81fcb7c1a491/data/default/foobar/abb5bed74a83e92119d39be5107ac1f2/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:58,938 INFO [Time-limited test] regionserver.HRegion(960): Onlined abb5bed74a83e92119d39be5107ac1f2; next sequenceid=2 2018-01-13 17:45:58,938 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:58,939 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:58,939 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:58,939 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:58,939 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:58,966 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,041 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreConcurrentControl[0] Thread=68 (was 69), OpenFileDescriptor=372 (was 375), MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=1899 (was 2027) 2018-01-13 17:45:59,055 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreDeletesVisibilityWithSameKey[0] Thread=54, OpenFileDescriptor=344, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=1898 2018-01-13 17:45:59,074 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:59,075 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:59,075 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718 2018-01-13 17:45:59,075 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718 2018-01-13 17:45:59,075 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:59,075 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718 2018-01-13 17:45:59,076 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:59,078 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-31122035, suffix=, logDir=file:/ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/WALs/hregion-31122035, archiveDir=file:/ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/oldWALs 2018-01-13 17:45:59,090 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/WALs/hregion-31122035/hregion-31122035.1515883559079 2018-01-13 17:45:59,090 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:59,090 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718 Table name == foobar 2018-01-13 17:45:59,100 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883559075.97ffe3b0243aa14fa408f5f292c56fcd. 2018-01-13 17:45:59,103 DEBUG [StoreOpener-97ffe3b0243aa14fa408f5f292c56fcd-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,103 INFO [StoreOpener-97ffe3b0243aa14fa408f5f292c56fcd-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,104 INFO [StoreOpener-97ffe3b0243aa14fa408f5f292c56fcd-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,104 INFO [StoreOpener-97ffe3b0243aa14fa408f5f292c56fcd-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,105 INFO [StoreOpener-97ffe3b0243aa14fa408f5f292c56fcd-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,110 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883559075.97ffe3b0243aa14fa408f5f292c56fcd. 2018-01-13 17:45:59,110 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/data/default/foobar/97ffe3b0243aa14fa408f5f292c56fcd 2018-01-13 17:45:59,111 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:59,130 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/data/default/foobar/97ffe3b0243aa14fa408f5f292c56fcd/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:59,130 INFO [Time-limited test] regionserver.HRegion(960): Onlined 97ffe3b0243aa14fa408f5f292c56fcd; next sequenceid=2 2018-01-13 17:45:59,130 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,131 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,131 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,131 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,131 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,169 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,186 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreDeletesVisibilityWithSameKey[0] Thread=57 (was 54) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/d9208214-4e60-4e7c-84f4-3af4b48ce718/WALs/hregion-31122035/hregion-31122035.1515883559079 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=349 (was 344) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=199 (was 199), AvailableMemoryMB=1894 (was 1898) 2018-01-13 17:45:59,200 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMultipleVersionsSimple[0] Thread=56, OpenFileDescriptor=349, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=1893 2018-01-13 17:45:59,236 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:59,237 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:59,237 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4 2018-01-13 17:45:59,237 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4 2018-01-13 17:45:59,237 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:59,237 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4 2018-01-13 17:45:59,238 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:59,239 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-11534622, suffix=, logDir=file:/ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/WALs/hregion-11534622, archiveDir=file:/ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/oldWALs 2018-01-13 17:45:59,245 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/WALs/hregion-11534622/hregion-11534622.1515883559239 2018-01-13 17:45:59,245 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:59,245 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4 Table name == foobar 2018-01-13 17:45:59,252 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883559237.77c4052701f1b8dfcfe3e75e13847d7f. 2018-01-13 17:45:59,254 DEBUG [StoreOpener-77c4052701f1b8dfcfe3e75e13847d7f-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,255 INFO [StoreOpener-77c4052701f1b8dfcfe3e75e13847d7f-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,255 INFO [StoreOpener-77c4052701f1b8dfcfe3e75e13847d7f-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,255 INFO [StoreOpener-77c4052701f1b8dfcfe3e75e13847d7f-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,255 INFO [StoreOpener-77c4052701f1b8dfcfe3e75e13847d7f-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,256 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883559237.77c4052701f1b8dfcfe3e75e13847d7f. 2018-01-13 17:45:59,256 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/data/default/foobar/77c4052701f1b8dfcfe3e75e13847d7f 2018-01-13 17:45:59,257 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:59,261 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/data/default/foobar/77c4052701f1b8dfcfe3e75e13847d7f/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:59,261 INFO [Time-limited test] regionserver.HRegion(960): Onlined 77c4052701f1b8dfcfe3e75e13847d7f; next sequenceid=2 2018-01-13 17:45:59,262 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,262 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,262 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,262 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,262 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,285 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,317 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMultipleVersionsSimple[0] Thread=59 (was 56) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/e59a6c47-27a6-42b4-8681-cc3f0e63cca4/WALs/hregion-11534622/hregion-11534622.1515883559239 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=354 (was 349) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=957 (was 957), ProcessCount=200 (was 199) - ProcessCount LEAK? -, AvailableMemoryMB=1889 (was 1893) 2018-01-13 17:45:59,331 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testReadOwnWritesUnderConcurrency[0] Thread=58, OpenFileDescriptor=356, MaxFileDescriptor=1048576, SystemLoadAverage=957, ProcessCount=199, AvailableMemoryMB=1888 2018-01-13 17:45:59,352 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:59,353 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:59,353 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21 2018-01-13 17:45:59,353 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21 2018-01-13 17:45:59,353 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:59,353 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21 2018-01-13 17:45:59,354 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:59,355 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-06498000, suffix=, logDir=file:/ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/WALs/hregion-06498000, archiveDir=file:/ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/oldWALs 2018-01-13 17:45:59,389 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/WALs/hregion-06498000/hregion-06498000.1515883559355 2018-01-13 17:45:59,389 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:45:59,389 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21 Table name == foobar 2018-01-13 17:45:59,410 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883559353.8c8c31f6e1fe24ec5d69de8fed5ccf53. 2018-01-13 17:45:59,412 DEBUG [StoreOpener-8c8c31f6e1fe24ec5d69de8fed5ccf53-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,412 INFO [StoreOpener-8c8c31f6e1fe24ec5d69de8fed5ccf53-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,412 INFO [StoreOpener-8c8c31f6e1fe24ec5d69de8fed5ccf53-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,413 INFO [StoreOpener-8c8c31f6e1fe24ec5d69de8fed5ccf53-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,426 INFO [StoreOpener-8c8c31f6e1fe24ec5d69de8fed5ccf53-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,426 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883559353.8c8c31f6e1fe24ec5d69de8fed5ccf53. 2018-01-13 17:45:59,427 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/data/default/foobar/8c8c31f6e1fe24ec5d69de8fed5ccf53 2018-01-13 17:45:59,427 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:45:59,432 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/data/default/foobar/8c8c31f6e1fe24ec5d69de8fed5ccf53/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:45:59,433 INFO [Time-limited test] regionserver.HRegion(960): Onlined 8c8c31f6e1fe24ec5d69de8fed5ccf53; next sequenceid=2 2018-01-13 17:45:59,433 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:45:59,433 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,433 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:45:59,434 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:45:59,434 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:45:59,455 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:45:59,929 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testReadOwnWritesUnderConcurrency[0] Thread=60 (was 58) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/9c0ed33b-c08e-4028-b9a3-b411dab84e21/WALs/hregion-06498000/hregion-06498000.1515883559355 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=359 (was 356) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 957) - SystemLoadAverage LEAK? -, ProcessCount=199 (was 199), AvailableMemoryMB=1868 (was 1888) 2018-01-13 17:45:59,962 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameCell[0] Thread=60, OpenFileDescriptor=359, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1867 2018-01-13 17:45:59,981 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:45:59,981 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:45:59,981 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/67c06839-8816-44b4-b09f-7429232b7a02 2018-01-13 17:45:59,981 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/67c06839-8816-44b4-b09f-7429232b7a02 2018-01-13 17:45:59,981 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:45:59,982 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/67c06839-8816-44b4-b09f-7429232b7a02 2018-01-13 17:45:59,985 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:45:59,986 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-26127453, suffix=, logDir=file:/ram4G/67c06839-8816-44b4-b09f-7429232b7a02/WALs/hregion-26127453, archiveDir=file:/ram4G/67c06839-8816-44b4-b09f-7429232b7a02/oldWALs 2018-01-13 17:46:00,022 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/67c06839-8816-44b4-b09f-7429232b7a02/WALs/hregion-26127453/hregion-26127453.1515883559986 2018-01-13 17:46:00,022 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,023 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/67c06839-8816-44b4-b09f-7429232b7a02 Table name == foobar 2018-01-13 17:46:00,047 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883559982.0ccf94658e5e398a8e5406d68b0187d1. 2018-01-13 17:46:00,054 DEBUG [StoreOpener-0ccf94658e5e398a8e5406d68b0187d1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,054 INFO [StoreOpener-0ccf94658e5e398a8e5406d68b0187d1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,054 INFO [StoreOpener-0ccf94658e5e398a8e5406d68b0187d1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,055 INFO [StoreOpener-0ccf94658e5e398a8e5406d68b0187d1-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,055 INFO [StoreOpener-0ccf94658e5e398a8e5406d68b0187d1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,055 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883559982.0ccf94658e5e398a8e5406d68b0187d1. 2018-01-13 17:46:00,056 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/67c06839-8816-44b4-b09f-7429232b7a02/data/default/foobar/0ccf94658e5e398a8e5406d68b0187d1 2018-01-13 17:46:00,056 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,096 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/67c06839-8816-44b4-b09f-7429232b7a02/data/default/foobar/0ccf94658e5e398a8e5406d68b0187d1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,097 INFO [Time-limited test] regionserver.HRegion(960): Onlined 0ccf94658e5e398a8e5406d68b0187d1; next sequenceid=2 2018-01-13 17:46:00,097 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,097 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,097 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,098 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,099 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,146 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,184 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameCell[0] Thread=63 (was 60) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/67c06839-8816-44b4-b09f-7429232b7a02/WALs/hregion-26127453/hregion-26127453.1515883559986 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=364 (was 359) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1859 (was 1867) 2018-01-13 17:46:00,203 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameKey[0] Thread=62, OpenFileDescriptor=366, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1858 2018-01-13 17:46:00,234 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:00,234 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:00,234 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1 2018-01-13 17:46:00,234 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1 2018-01-13 17:46:00,234 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:00,234 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1 2018-01-13 17:46:00,235 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:00,236 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-83045760, suffix=, logDir=file:/ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/WALs/hregion-83045760, archiveDir=file:/ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/oldWALs 2018-01-13 17:46:00,244 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/WALs/hregion-83045760/hregion-83045760.1515883560237 2018-01-13 17:46:00,244 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,245 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1 Table name == foobar 2018-01-13 17:46:00,252 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883560234.e88bf5001685e6915c41a655d42abdbb. 2018-01-13 17:46:00,255 DEBUG [StoreOpener-e88bf5001685e6915c41a655d42abdbb-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,256 INFO [StoreOpener-e88bf5001685e6915c41a655d42abdbb-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,257 INFO [StoreOpener-e88bf5001685e6915c41a655d42abdbb-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,258 INFO [StoreOpener-e88bf5001685e6915c41a655d42abdbb-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,259 INFO [StoreOpener-e88bf5001685e6915c41a655d42abdbb-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,261 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883560234.e88bf5001685e6915c41a655d42abdbb. 2018-01-13 17:46:00,261 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/data/default/foobar/e88bf5001685e6915c41a655d42abdbb 2018-01-13 17:46:00,261 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,298 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/data/default/foobar/e88bf5001685e6915c41a655d42abdbb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,298 INFO [Time-limited test] regionserver.HRegion(960): Onlined e88bf5001685e6915c41a655d42abdbb; next sequenceid=2 2018-01-13 17:46:00,299 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,299 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,299 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,299 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,300 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,333 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,361 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameKey[0] Thread=64 (was 62) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/05327099-8bb0-4c59-a3da-ec17be50e1f1/WALs/hregion-83045760/hregion-83045760.1515883560237 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=369 (was 366) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1855 (was 1858) 2018-01-13 17:46:00,373 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteVersion[0] Thread=64, OpenFileDescriptor=369, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=200, AvailableMemoryMB=1855 2018-01-13 17:46:00,397 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:00,397 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:00,397 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15 2018-01-13 17:46:00,397 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15 2018-01-13 17:46:00,398 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:00,398 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15 2018-01-13 17:46:00,400 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:00,401 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-46313889, suffix=, logDir=file:/ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/WALs/hregion-46313889, archiveDir=file:/ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/oldWALs 2018-01-13 17:46:00,425 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/WALs/hregion-46313889/hregion-46313889.1515883560402 2018-01-13 17:46:00,425 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,425 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15 Table name == foobar 2018-01-13 17:46:00,441 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883560398.b1638ae5809350cc213d2c735f1bec09. 2018-01-13 17:46:00,444 DEBUG [StoreOpener-b1638ae5809350cc213d2c735f1bec09-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,448 INFO [StoreOpener-b1638ae5809350cc213d2c735f1bec09-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,448 INFO [StoreOpener-b1638ae5809350cc213d2c735f1bec09-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,448 INFO [StoreOpener-b1638ae5809350cc213d2c735f1bec09-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,448 INFO [StoreOpener-b1638ae5809350cc213d2c735f1bec09-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,449 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883560398.b1638ae5809350cc213d2c735f1bec09. 2018-01-13 17:46:00,449 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/data/default/foobar/b1638ae5809350cc213d2c735f1bec09 2018-01-13 17:46:00,449 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,483 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/data/default/foobar/b1638ae5809350cc213d2c735f1bec09/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,483 INFO [Time-limited test] regionserver.HRegion(960): Onlined b1638ae5809350cc213d2c735f1bec09; next sequenceid=2 2018-01-13 17:46:00,484 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,484 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,484 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,484 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,485 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,503 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,517 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteVersion[0] Thread=66 (was 64) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/87bdcf3f-16d3-4dd9-bee3-29c3f2599d15/WALs/hregion-46313889/hregion-46313889.1515883560402 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=374 (was 369) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=200 (was 200), AvailableMemoryMB=1849 (was 1855) 2018-01-13 17:46:00,532 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToBigCellChunkMap[1] Thread=66, OpenFileDescriptor=374, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=200, AvailableMemoryMB=1848 2018-01-13 17:46:00,547 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:00,547 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:00,548 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37 2018-01-13 17:46:00,548 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37 2018-01-13 17:46:00,548 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:00,548 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37 2018-01-13 17:46:00,549 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:00,553 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-03934999, suffix=, logDir=file:/ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/WALs/hregion-03934999, archiveDir=file:/ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/oldWALs 2018-01-13 17:46:00,572 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/WALs/hregion-03934999/hregion-03934999.1515883560553 2018-01-13 17:46:00,573 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,573 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37 Table name == foobar 2018-01-13 17:46:00,605 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883560548.9d4ae79bc4ae0014793bc585dd72470d. 2018-01-13 17:46:00,606 DEBUG [StoreOpener-9d4ae79bc4ae0014793bc585dd72470d-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,606 INFO [StoreOpener-9d4ae79bc4ae0014793bc585dd72470d-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,606 INFO [StoreOpener-9d4ae79bc4ae0014793bc585dd72470d-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,606 INFO [StoreOpener-9d4ae79bc4ae0014793bc585dd72470d-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,607 INFO [StoreOpener-9d4ae79bc4ae0014793bc585dd72470d-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,608 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883560548.9d4ae79bc4ae0014793bc585dd72470d. 2018-01-13 17:46:00,608 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/data/default/foobar/9d4ae79bc4ae0014793bc585dd72470d 2018-01-13 17:46:00,609 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,647 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/data/default/foobar/9d4ae79bc4ae0014793bc585dd72470d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,648 INFO [Time-limited test] regionserver.HRegion(960): Onlined 9d4ae79bc4ae0014793bc585dd72470d; next sequenceid=2 2018-01-13 17:46:00,648 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,648 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,649 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,649 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,649 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,672 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,684 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToBigCellChunkMap[1] Thread=69 (was 66) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/2ba32236-cd4e-437d-a19e-5e5a827e5b37/WALs/hregion-03934999/hregion-03934999.1515883560553 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=379 (was 374) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 200), AvailableMemoryMB=1842 (was 1848) 2018-01-13 17:46:00,697 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByScan[1] Thread=68, OpenFileDescriptor=379, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1841 2018-01-13 17:46:00,712 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:00,712 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:00,713 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2 2018-01-13 17:46:00,713 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2 2018-01-13 17:46:00,713 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:00,713 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2 2018-01-13 17:46:00,714 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:00,714 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-44110814, suffix=, logDir=file:/ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/WALs/hregion-44110814, archiveDir=file:/ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/oldWALs 2018-01-13 17:46:00,742 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/WALs/hregion-44110814/hregion-44110814.1515883560715 2018-01-13 17:46:00,742 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,742 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2 Table name == foobar 2018-01-13 17:46:00,750 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883560713.b4b563372bd096e78fac1195c91f80e4. 2018-01-13 17:46:00,752 DEBUG [StoreOpener-b4b563372bd096e78fac1195c91f80e4-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,753 INFO [StoreOpener-b4b563372bd096e78fac1195c91f80e4-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,753 INFO [StoreOpener-b4b563372bd096e78fac1195c91f80e4-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,753 INFO [StoreOpener-b4b563372bd096e78fac1195c91f80e4-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,753 INFO [StoreOpener-b4b563372bd096e78fac1195c91f80e4-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,753 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883560713.b4b563372bd096e78fac1195c91f80e4. 2018-01-13 17:46:00,754 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/data/default/foobar/b4b563372bd096e78fac1195c91f80e4 2018-01-13 17:46:00,754 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,772 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/data/default/foobar/b4b563372bd096e78fac1195c91f80e4/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,772 INFO [Time-limited test] regionserver.HRegion(960): Onlined b4b563372bd096e78fac1195c91f80e4; next sequenceid=2 2018-01-13 17:46:00,773 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,773 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,773 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,773 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,774 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,840 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,854 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:00,854 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:00,871 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=150, cellSize=7290, totalHeapSize=11976, min timestamp=1515883560841, max timestamp=1515883560852Num uniques 150; 2018-01-13 17:46:00,871 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=7290, new segment data size=7290, suffix heap size=19176,new segment heap size=11976 2018-01-13 17:46:00,888 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByScan[1] Thread=70 (was 68) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/ce44bc35-212a-4040-9d1b-f6c59d2eb8f2/WALs/hregion-44110814/hregion-44110814.1515883560715 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=384 (was 379) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1786 (was 1841) 2018-01-13 17:46:00,899 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToJumboCellChunkMap[1] Thread=70, OpenFileDescriptor=384, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1783 2018-01-13 17:46:00,948 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:00,948 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:00,948 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4 2018-01-13 17:46:00,948 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4 2018-01-13 17:46:00,948 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:00,948 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4 2018-01-13 17:46:00,949 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:00,950 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-34918090, suffix=, logDir=file:/ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/WALs/hregion-34918090, archiveDir=file:/ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/oldWALs 2018-01-13 17:46:00,956 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/WALs/hregion-34918090/hregion-34918090.1515883560950 2018-01-13 17:46:00,957 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:00,957 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4 Table name == foobar 2018-01-13 17:46:00,963 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883560948.fa0ba96a03160e6a6ffcfe2ee5bb25ae. 2018-01-13 17:46:00,964 DEBUG [StoreOpener-fa0ba96a03160e6a6ffcfe2ee5bb25ae-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,964 INFO [StoreOpener-fa0ba96a03160e6a6ffcfe2ee5bb25ae-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,964 INFO [StoreOpener-fa0ba96a03160e6a6ffcfe2ee5bb25ae-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,964 INFO [StoreOpener-fa0ba96a03160e6a6ffcfe2ee5bb25ae-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,965 INFO [StoreOpener-fa0ba96a03160e6a6ffcfe2ee5bb25ae-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:00,965 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883560948.fa0ba96a03160e6a6ffcfe2ee5bb25ae. 2018-01-13 17:46:00,966 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/data/default/foobar/fa0ba96a03160e6a6ffcfe2ee5bb25ae 2018-01-13 17:46:00,966 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:00,982 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/data/default/foobar/fa0ba96a03160e6a6ffcfe2ee5bb25ae/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:00,982 INFO [Time-limited test] regionserver.HRegion(960): Onlined fa0ba96a03160e6a6ffcfe2ee5bb25ae; next sequenceid=2 2018-01-13 17:46:00,983 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:00,983 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:00,983 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:00,983 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:00,984 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,005 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,019 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToJumboCellChunkMap[1] Thread=72 (was 70) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/88a885bc-a2e2-4c2e-b6dc-0f8e3bd932f4/WALs/hregion-34918090/hregion-34918090.1515883560950 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=389 (was 384) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1764 (was 1783) 2018-01-13 17:46:01,031 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMerging[1] Thread=72, OpenFileDescriptor=389, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1763 2018-01-13 17:46:01,047 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,047 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,047 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be 2018-01-13 17:46:01,047 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be 2018-01-13 17:46:01,047 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,048 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be 2018-01-13 17:46:01,048 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,049 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-98877310, suffix=, logDir=file:/ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/WALs/hregion-98877310, archiveDir=file:/ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/oldWALs 2018-01-13 17:46:01,053 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/WALs/hregion-98877310/hregion-98877310.1515883561049 2018-01-13 17:46:01,053 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,053 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be Table name == foobar 2018-01-13 17:46:01,059 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561048.ed8b01d128c6ce5841dd71346b8b15e5. 2018-01-13 17:46:01,061 DEBUG [StoreOpener-ed8b01d128c6ce5841dd71346b8b15e5-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,061 INFO [StoreOpener-ed8b01d128c6ce5841dd71346b8b15e5-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,061 INFO [StoreOpener-ed8b01d128c6ce5841dd71346b8b15e5-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,061 INFO [StoreOpener-ed8b01d128c6ce5841dd71346b8b15e5-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,062 INFO [StoreOpener-ed8b01d128c6ce5841dd71346b8b15e5-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,062 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561048.ed8b01d128c6ce5841dd71346b8b15e5. 2018-01-13 17:46:01,062 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/data/default/foobar/ed8b01d128c6ce5841dd71346b8b15e5 2018-01-13 17:46:01,063 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,068 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/data/default/foobar/ed8b01d128c6ce5841dd71346b8b15e5/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,068 INFO [Time-limited test] regionserver.HRegion(960): Onlined ed8b01d128c6ce5841dd71346b8b15e5; next sequenceid=2 2018-01-13 17:46:01,068 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,069 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,069 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,069 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,069 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,089 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,091 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x82\x04, timestamp1515883561090 2018-01-13 17:46:01,093 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x83\x04, timestamp1515883561091 2018-01-13 17:46:01,094 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x85\x04, timestamp1515883561093 2018-01-13 17:46:01,095 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x86\x04, timestamp1515883561094 2018-01-13 17:46:01,096 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01F\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x87\x04, timestamp1515883561095 2018-01-13 17:46:01,097 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01H\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x88\x04, timestamp1515883561096 2018-01-13 17:46:01,098 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,098 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:01,099 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=6, cellSize=276, totalHeapSize=936, min timestamp=1515883561090, max timestamp=1515883561096Num uniques -1; flattened 2018-01-13 17:46:01,100 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x8B\x04, timestamp1515883561099 2018-01-13 17:46:01,101 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x8C\x04, timestamp1515883561100 2018-01-13 17:46:01,103 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x8E\x04, timestamp1515883561102 2018-01-13 17:46:01,104 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01G\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x8F\x04, timestamp1515883561103 2018-01-13 17:46:01,105 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01I\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x90\x04, timestamp1515883561104 2018-01-13 17:46:01,106 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01J\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x91\x04, timestamp1515883561105 2018-01-13 17:46:01,108 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x93\x04, timestamp1515883561107 2018-01-13 17:46:01,110 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x94\x04, timestamp1515883561108 2018-01-13 17:46:01,111 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x96\x04, timestamp1515883561110 2018-01-13 17:46:01,112 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01E\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x80\x97\x04, timestamp1515883561111 2018-01-13 17:46:01,112 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,112 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:01,113 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=696, min timestamp=1515883561107, max timestamp=1515883561111Num uniques -1; flattened 2018-01-13 17:46:01,113 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883561048.ed8b01d128c6ce5841dd71346b8b15e5.store: column 2018-01-13 17:46:01,114 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=null 2018-01-13 17:46:01,128 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMerging[1] Thread=74 (was 72) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/ab9ad8df-e60a-4c2a-ba81-d64fe056f7be/WALs/hregion-98877310/hregion-98877310.1515883561049 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=394 (was 389) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1758 (was 1763) 2018-01-13 17:46:01,142 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterMerge[1] Thread=74, OpenFileDescriptor=397, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1757 2018-01-13 17:46:01,155 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,156 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,156 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2 2018-01-13 17:46:01,156 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2 2018-01-13 17:46:01,156 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,156 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2 2018-01-13 17:46:01,156 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,157 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-44775560, suffix=, logDir=file:/ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/WALs/hregion-44775560, archiveDir=file:/ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/oldWALs 2018-01-13 17:46:01,162 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/WALs/hregion-44775560/hregion-44775560.1515883561157 2018-01-13 17:46:01,163 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,163 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2 Table name == foobar 2018-01-13 17:46:01,168 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561156.206c6958db213f3e4b96dd22edc9f1db. 2018-01-13 17:46:01,169 DEBUG [StoreOpener-206c6958db213f3e4b96dd22edc9f1db-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,169 INFO [StoreOpener-206c6958db213f3e4b96dd22edc9f1db-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,170 INFO [StoreOpener-206c6958db213f3e4b96dd22edc9f1db-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,170 INFO [StoreOpener-206c6958db213f3e4b96dd22edc9f1db-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,170 INFO [StoreOpener-206c6958db213f3e4b96dd22edc9f1db-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,171 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561156.206c6958db213f3e4b96dd22edc9f1db. 2018-01-13 17:46:01,171 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/data/default/foobar/206c6958db213f3e4b96dd22edc9f1db 2018-01-13 17:46:01,171 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,176 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/data/default/foobar/206c6958db213f3e4b96dd22edc9f1db/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,176 INFO [Time-limited test] regionserver.HRegion(960): Onlined 206c6958db213f3e4b96dd22edc9f1db; next sequenceid=2 2018-01-13 17:46:01,177 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,177 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,177 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,177 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,178 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,195 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,196 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,196 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:01,197 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=2, cellSize=64, totalHeapSize=424, min timestamp=101, max timestamp=102Num uniques -1; flattened 2018-01-13 17:46:01,198 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,198 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): BASIC in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:01,199 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=2, cellSize=64, totalHeapSize=424, min timestamp=103, max timestamp=104Num uniques -1; flattened 2018-01-13 17:46:01,212 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterMerge[1] Thread=77 (was 74) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/63507f51-c0af-4311-8c3f-54d7d2177be2/WALs/hregion-44775560/hregion-44775560.1515883561157 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=399 (was 397) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1765 (was 1757) - AvailableMemoryMB LEAK? - 2018-01-13 17:46:01,225 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByIterator[1] Thread=76, OpenFileDescriptor=399, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1765 2018-01-13 17:46:01,240 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,240 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,240 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd 2018-01-13 17:46:01,240 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd 2018-01-13 17:46:01,240 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,240 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd 2018-01-13 17:46:01,242 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,242 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-54291402, suffix=, logDir=file:/ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/WALs/hregion-54291402, archiveDir=file:/ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/oldWALs 2018-01-13 17:46:01,248 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/WALs/hregion-54291402/hregion-54291402.1515883561243 2018-01-13 17:46:01,249 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,249 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd Table name == foobar 2018-01-13 17:46:01,256 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561240.03b76332e76658c66182c40eaf9a1f68. 2018-01-13 17:46:01,257 DEBUG [StoreOpener-03b76332e76658c66182c40eaf9a1f68-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,257 INFO [StoreOpener-03b76332e76658c66182c40eaf9a1f68-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,257 INFO [StoreOpener-03b76332e76658c66182c40eaf9a1f68-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,257 INFO [StoreOpener-03b76332e76658c66182c40eaf9a1f68-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,258 INFO [StoreOpener-03b76332e76658c66182c40eaf9a1f68-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,258 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561240.03b76332e76658c66182c40eaf9a1f68. 2018-01-13 17:46:01,258 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/data/default/foobar/03b76332e76658c66182c40eaf9a1f68 2018-01-13 17:46:01,259 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,264 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/data/default/foobar/03b76332e76658c66182c40eaf9a1f68/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,265 INFO [Time-limited test] regionserver.HRegion(960): Onlined 03b76332e76658c66182c40eaf9a1f68; next sequenceid=2 2018-01-13 17:46:01,265 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,266 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,266 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,266 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,266 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,286 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,297 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,297 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:01,300 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=150, cellSize=7290, totalHeapSize=11976, min timestamp=1515883561286, max timestamp=1515883561295Num uniques 150; 2018-01-13 17:46:01,300 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=7290, new segment data size=7290, suffix heap size=19176,new segment heap size=11976 2018-01-13 17:46:01,316 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCountOfCellsAfterFlatteningByIterator[1] Thread=78 (was 76) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/05b8d62e-7c05-40c4-b1dd-d91bbc8c6ebd/WALs/hregion-54291402/hregion-54291402.1515883561243 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=404 (was 399) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1759 (was 1765) 2018-01-13 17:46:01,332 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterCompaction[1] Thread=78, OpenFileDescriptor=404, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1760 2018-01-13 17:46:01,362 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,362 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,362 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d 2018-01-13 17:46:01,363 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d 2018-01-13 17:46:01,363 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,363 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d 2018-01-13 17:46:01,363 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,364 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-90442196, suffix=, logDir=file:/ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/WALs/hregion-90442196, archiveDir=file:/ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/oldWALs 2018-01-13 17:46:01,385 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/WALs/hregion-90442196/hregion-90442196.1515883561365 2018-01-13 17:46:01,385 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,385 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d Table name == foobar 2018-01-13 17:46:01,391 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561363.311b16f2e12a7612a7b8affb5e1a3ecd. 2018-01-13 17:46:01,392 DEBUG [StoreOpener-311b16f2e12a7612a7b8affb5e1a3ecd-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,393 INFO [StoreOpener-311b16f2e12a7612a7b8affb5e1a3ecd-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,393 INFO [StoreOpener-311b16f2e12a7612a7b8affb5e1a3ecd-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,393 INFO [StoreOpener-311b16f2e12a7612a7b8affb5e1a3ecd-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,393 INFO [StoreOpener-311b16f2e12a7612a7b8affb5e1a3ecd-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,394 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561363.311b16f2e12a7612a7b8affb5e1a3ecd. 2018-01-13 17:46:01,394 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/data/default/foobar/311b16f2e12a7612a7b8affb5e1a3ecd 2018-01-13 17:46:01,394 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,400 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/data/default/foobar/311b16f2e12a7612a7b8affb5e1a3ecd/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,401 INFO [Time-limited test] regionserver.HRegion(960): Onlined 311b16f2e12a7612a7b8affb5e1a3ecd; next sequenceid=2 2018-01-13 17:46:01,401 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,401 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,401 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,401 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,402 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,429 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,430 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,430 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:01,432 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=1, cellSize=32, totalHeapSize=272, min timestamp=102, max timestamp=102Num uniques 2; 2018-01-13 17:46:01,433 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883561363.311b16f2e12a7612a7b8affb5e1a3ecd.) memstoreSize to a negative value which is incorrect. Current memstoreSize=0, delta=-32 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRange(TestCompactingToCellFlatMapMemStore.java:401) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRangeAfterCompaction(TestCompactingToCellFlatMapMemStore.java:366) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,433 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=64, new segment data size=32, suffix heap size=424,new segment heap size=272 2018-01-13 17:46:01,434 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:01,434 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 2 segments 2018-01-13 17:46:01,435 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=1, cellSize=32, totalHeapSize=272, min timestamp=104, max timestamp=104Num uniques 3; 2018-01-13 17:46:01,436 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883561363.311b16f2e12a7612a7b8affb5e1a3ecd.) memstoreSize to a negative value which is incorrect. Current memstoreSize=-32, delta=-64 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRange(TestCompactingToCellFlatMapMemStore.java:421) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.testTimeRangeAfterCompaction(TestCompactingToCellFlatMapMemStore.java:366) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,437 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=96, new segment data size=32, suffix heap size=696,new segment heap size=272 2018-01-13 17:46:01,459 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testTimeRangeAfterCompaction[1] Thread=80 (was 78) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/c8530663-3973-448b-bb38-7441ac59ab0d/WALs/hregion-90442196/hregion-90442196.1515883561365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=409 (was 404) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1753 (was 1760) 2018-01-13 17:46:01,485 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksAfterFlushing[1] Thread=80, OpenFileDescriptor=409, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1751 2018-01-13 17:46:01,516 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,516 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,516 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30 2018-01-13 17:46:01,516 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30 2018-01-13 17:46:01,516 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,516 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30 2018-01-13 17:46:01,517 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,518 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-48479467, suffix=, logDir=file:/ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/WALs/hregion-48479467, archiveDir=file:/ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/oldWALs 2018-01-13 17:46:01,524 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/WALs/hregion-48479467/hregion-48479467.1515883561518 2018-01-13 17:46:01,524 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,524 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30 Table name == foobar 2018-01-13 17:46:01,530 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561516.10e129e1ba7b579d3e937326f8ad9a2b. 2018-01-13 17:46:01,531 DEBUG [StoreOpener-10e129e1ba7b579d3e937326f8ad9a2b-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,532 INFO [StoreOpener-10e129e1ba7b579d3e937326f8ad9a2b-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,532 INFO [StoreOpener-10e129e1ba7b579d3e937326f8ad9a2b-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,533 INFO [StoreOpener-10e129e1ba7b579d3e937326f8ad9a2b-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,533 INFO [StoreOpener-10e129e1ba7b579d3e937326f8ad9a2b-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,534 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561516.10e129e1ba7b579d3e937326f8ad9a2b. 2018-01-13 17:46:01,534 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/data/default/foobar/10e129e1ba7b579d3e937326f8ad9a2b 2018-01-13 17:46:01,535 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,542 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/data/default/foobar/10e129e1ba7b579d3e937326f8ad9a2b/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,542 INFO [Time-limited test] regionserver.HRegion(960): Onlined 10e129e1ba7b579d3e937326f8ad9a2b; next sequenceid=2 2018-01-13 17:46:01,542 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,543 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,543 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,543 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,543 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,562 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,564 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883561516.10e129e1ba7b579d3e937326f8ad9a2b.store: column 2018-01-13 17:46:01,564 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:01,580 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksAfterFlushing[1] Thread=83 (was 80) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/878c6e4a-bac1-4284-bd55-517a0e190f30/WALs/hregion-48479467/hregion-48479467.1515883561518 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=414 (was 409) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1718 (was 1751) 2018-01-13 17:46:01,607 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningScanner[1] Thread=82, OpenFileDescriptor=414, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1714 2018-01-13 17:46:01,622 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,622 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,622 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041 2018-01-13 17:46:01,622 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041 2018-01-13 17:46:01,623 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,623 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041 2018-01-13 17:46:01,623 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,624 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-07541227, suffix=, logDir=file:/ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/WALs/hregion-07541227, archiveDir=file:/ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/oldWALs 2018-01-13 17:46:01,645 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/WALs/hregion-07541227/hregion-07541227.1515883561624 2018-01-13 17:46:01,646 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,646 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041 Table name == foobar 2018-01-13 17:46:01,652 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561623.e79732721551494e4daa3d6b93adfb9d. 2018-01-13 17:46:01,655 DEBUG [StoreOpener-e79732721551494e4daa3d6b93adfb9d-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,657 INFO [StoreOpener-e79732721551494e4daa3d6b93adfb9d-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,657 INFO [StoreOpener-e79732721551494e4daa3d6b93adfb9d-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,658 INFO [StoreOpener-e79732721551494e4daa3d6b93adfb9d-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,658 INFO [StoreOpener-e79732721551494e4daa3d6b93adfb9d-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,659 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561623.e79732721551494e4daa3d6b93adfb9d. 2018-01-13 17:46:01,659 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/data/default/foobar/e79732721551494e4daa3d6b93adfb9d 2018-01-13 17:46:01,659 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,678 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/data/default/foobar/e79732721551494e4daa3d6b93adfb9d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,678 INFO [Time-limited test] regionserver.HRegion(960): Onlined e79732721551494e4daa3d6b93adfb9d; next sequenceid=2 2018-01-13 17:46:01,678 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,678 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,678 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,679 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,679 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,699 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,700 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883561623.e79732721551494e4daa3d6b93adfb9d.store: column 2018-01-13 17:46:01,700 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:01,701 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883561623.e79732721551494e4daa3d6b93adfb9d.store: column 2018-01-13 17:46:01,701 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:01,714 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningScanner[1] Thread=84 (was 82) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/7671a2b8-e593-4a19-ba7f-ccdcb7869041/WALs/hregion-07541227/hregion-07541227.1515883561624 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=419 (was 414) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1705 (was 1714) 2018-01-13 17:46:01,725 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToCellChunkMap[1] Thread=84, OpenFileDescriptor=421, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1705 2018-01-13 17:46:01,739 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:01,739 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:01,739 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3 2018-01-13 17:46:01,739 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3 2018-01-13 17:46:01,739 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:01,739 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3 2018-01-13 17:46:01,740 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:01,742 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-74177047, suffix=, logDir=file:/ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3/WALs/hregion-74177047, archiveDir=file:/ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3/oldWALs 2018-01-13 17:46:01,750 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3/WALs/hregion-74177047/hregion-74177047.1515883561742 2018-01-13 17:46:01,750 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:01,750 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3 Table name == foobar 2018-01-13 17:46:01,757 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883561740.eae368904c620aee1fb348612677f924. 2018-01-13 17:46:01,758 DEBUG [StoreOpener-eae368904c620aee1fb348612677f924-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,758 INFO [StoreOpener-eae368904c620aee1fb348612677f924-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,758 INFO [StoreOpener-eae368904c620aee1fb348612677f924-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,759 INFO [StoreOpener-eae368904c620aee1fb348612677f924-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,759 INFO [StoreOpener-eae368904c620aee1fb348612677f924-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:01,760 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883561740.eae368904c620aee1fb348612677f924. 2018-01-13 17:46:01,760 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3/data/default/foobar/eae368904c620aee1fb348612677f924 2018-01-13 17:46:01,760 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:01,767 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/5e21bd47-5c05-4ead-bd2b-aaecce1635a3/data/default/foobar/eae368904c620aee1fb348612677f924/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:01,767 INFO [Time-limited test] regionserver.HRegion(960): Onlined eae368904c620aee1fb348612677f924; next sequenceid=2 2018-01-13 17:46:01,767 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:01,768 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:01,768 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:01,768 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:01,768 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,027 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,044 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testFlatteningToCellChunkMap[1] Thread=69 (was 84), OpenFileDescriptor=390 (was 421), MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1503 (was 1705) 2018-01-13 17:46:02,058 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetNextRow[1] Thread=69, OpenFileDescriptor=390, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1503 2018-01-13 17:46:02,075 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,075 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,076 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e 2018-01-13 17:46:02,076 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e 2018-01-13 17:46:02,076 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,076 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e 2018-01-13 17:46:02,080 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,081 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-92977257, suffix=, logDir=file:/ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/WALs/hregion-92977257, archiveDir=file:/ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/oldWALs 2018-01-13 17:46:02,088 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/WALs/hregion-92977257/hregion-92977257.1515883562081 2018-01-13 17:46:02,088 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,089 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e Table name == foobar 2018-01-13 17:46:02,094 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562079.e65cb02e7f2dffb6940f0b0300f5ea2c. 2018-01-13 17:46:02,099 DEBUG [StoreOpener-e65cb02e7f2dffb6940f0b0300f5ea2c-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,099 INFO [StoreOpener-e65cb02e7f2dffb6940f0b0300f5ea2c-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,099 INFO [StoreOpener-e65cb02e7f2dffb6940f0b0300f5ea2c-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,099 INFO [StoreOpener-e65cb02e7f2dffb6940f0b0300f5ea2c-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,100 INFO [StoreOpener-e65cb02e7f2dffb6940f0b0300f5ea2c-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,100 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562079.e65cb02e7f2dffb6940f0b0300f5ea2c. 2018-01-13 17:46:02,100 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/data/default/foobar/e65cb02e7f2dffb6940f0b0300f5ea2c 2018-01-13 17:46:02,100 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,106 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/data/default/foobar/e65cb02e7f2dffb6940f0b0300f5ea2c/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,106 INFO [Time-limited test] regionserver.HRegion(960): Onlined e65cb02e7f2dffb6940f0b0300f5ea2c; next sequenceid=2 2018-01-13 17:46:02,106 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,107 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,107 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,107 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,107 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,125 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,165 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetNextRow[1] Thread=72 (was 69) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/c419d33a-419c-4a29-b693-9964546bbb6e/WALs/hregion-92977257/hregion-92977257.1515883562081 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=395 (was 390) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1499 (was 1503) 2018-01-13 17:46:02,176 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testUpdateToTimeOfOldestEdit[1] Thread=71, OpenFileDescriptor=395, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1499 2018-01-13 17:46:02,191 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,191 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,191 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247 2018-01-13 17:46:02,191 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247 2018-01-13 17:46:02,191 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,191 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247 2018-01-13 17:46:02,192 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,192 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-02061094, suffix=, logDir=file:/ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/WALs/hregion-02061094, archiveDir=file:/ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/oldWALs 2018-01-13 17:46:02,202 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/WALs/hregion-02061094/hregion-02061094.1515883562193 2018-01-13 17:46:02,202 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,202 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247 Table name == foobar 2018-01-13 17:46:02,208 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562191.bdd2e2b75dbf3d31f2789ec6d6525b98. 2018-01-13 17:46:02,209 DEBUG [StoreOpener-bdd2e2b75dbf3d31f2789ec6d6525b98-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,209 INFO [StoreOpener-bdd2e2b75dbf3d31f2789ec6d6525b98-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,209 INFO [StoreOpener-bdd2e2b75dbf3d31f2789ec6d6525b98-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,210 INFO [StoreOpener-bdd2e2b75dbf3d31f2789ec6d6525b98-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,210 INFO [StoreOpener-bdd2e2b75dbf3d31f2789ec6d6525b98-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,210 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562191.bdd2e2b75dbf3d31f2789ec6d6525b98. 2018-01-13 17:46:02,211 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/data/default/foobar/bdd2e2b75dbf3d31f2789ec6d6525b98 2018-01-13 17:46:02,211 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,217 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/data/default/foobar/bdd2e2b75dbf3d31f2789ec6d6525b98/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,217 INFO [Time-limited test] regionserver.HRegion(960): Onlined bdd2e2b75dbf3d31f2789ec6d6525b98; next sequenceid=2 2018-01-13 17:46:02,217 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,217 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,217 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,218 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,218 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,245 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,245 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562191.bdd2e2b75dbf3d31f2789ec6d6525b98.store: column 2018-01-13 17:46:02,245 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,246 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,246 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562191.bdd2e2b75dbf3d31f2789ec6d6525b98.store: column 2018-01-13 17:46:02,246 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,246 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,258 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testUpdateToTimeOfOldestEdit[1] Thread=73 (was 71) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/0bf4c064-dfc2-43dc-bbbc-6d65d181c247/WALs/hregion-02061094/hregion-02061094.1515883562193 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=400 (was 395) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1494 (was 1499) 2018-01-13 17:46:02,269 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testUpsertMemstoreSize[1] Thread=73, OpenFileDescriptor=400, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1493 2018-01-13 17:46:02,282 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,282 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,283 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054 2018-01-13 17:46:02,283 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054 2018-01-13 17:46:02,283 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,283 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054 2018-01-13 17:46:02,284 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,285 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-61297174, suffix=, logDir=file:/ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/WALs/hregion-61297174, archiveDir=file:/ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/oldWALs 2018-01-13 17:46:02,295 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/WALs/hregion-61297174/hregion-61297174.1515883562285 2018-01-13 17:46:02,295 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,296 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054 Table name == foobar 2018-01-13 17:46:02,301 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562283.378e4288935aa0e3d27c1ab4d3bc6096. 2018-01-13 17:46:02,302 DEBUG [StoreOpener-378e4288935aa0e3d27c1ab4d3bc6096-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,303 INFO [StoreOpener-378e4288935aa0e3d27c1ab4d3bc6096-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,303 INFO [StoreOpener-378e4288935aa0e3d27c1ab4d3bc6096-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,303 INFO [StoreOpener-378e4288935aa0e3d27c1ab4d3bc6096-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,303 INFO [StoreOpener-378e4288935aa0e3d27c1ab4d3bc6096-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,304 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562283.378e4288935aa0e3d27c1ab4d3bc6096. 2018-01-13 17:46:02,304 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/data/default/foobar/378e4288935aa0e3d27c1ab4d3bc6096 2018-01-13 17:46:02,304 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,312 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/data/default/foobar/378e4288935aa0e3d27c1ab4d3bc6096/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,312 INFO [Time-limited test] regionserver.HRegion(960): Onlined 378e4288935aa0e3d27c1ab4d3bc6096; next sequenceid=2 2018-01-13 17:46:02,312 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,313 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,313 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,313 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,313 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,332 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,344 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testUpsertMemstoreSize[1] Thread=75 (was 73) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/eaf88187-26c9-4fbf-b6a5-71a6146c0054/WALs/hregion-61297174/hregion-61297174.1515883562285 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=405 (was 400) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1490 (was 1493) 2018-01-13 17:46:02,358 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction2Buckets[1] Thread=75, OpenFileDescriptor=405, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1490 2018-01-13 17:46:02,376 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,376 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,376 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89 2018-01-13 17:46:02,377 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89 2018-01-13 17:46:02,377 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,377 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89 2018-01-13 17:46:02,378 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,379 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-56728512, suffix=, logDir=file:/ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/WALs/hregion-56728512, archiveDir=file:/ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/oldWALs 2018-01-13 17:46:02,384 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/WALs/hregion-56728512/hregion-56728512.1515883562379 2018-01-13 17:46:02,385 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,385 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89 Table name == foobar 2018-01-13 17:46:02,391 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562377.2499425c68903542ae1aa95642001803. 2018-01-13 17:46:02,393 DEBUG [StoreOpener-2499425c68903542ae1aa95642001803-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,393 INFO [StoreOpener-2499425c68903542ae1aa95642001803-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,393 INFO [StoreOpener-2499425c68903542ae1aa95642001803-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,394 INFO [StoreOpener-2499425c68903542ae1aa95642001803-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,394 INFO [StoreOpener-2499425c68903542ae1aa95642001803-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,394 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562377.2499425c68903542ae1aa95642001803. 2018-01-13 17:46:02,395 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/data/default/foobar/2499425c68903542ae1aa95642001803 2018-01-13 17:46:02,395 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,401 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/data/default/foobar/2499425c68903542ae1aa95642001803/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,401 INFO [Time-limited test] regionserver.HRegion(960): Onlined 2499425c68903542ae1aa95642001803; next sequenceid=2 2018-01-13 17:46:02,401 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,402 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,402 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,402 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,402 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,428 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,430 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xBC\x04, timestamp1515883562428 2018-01-13 17:46:02,431 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xBE\x04, timestamp1515883562430 2018-01-13 17:46:02,432 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xBF\x04, timestamp1515883562431 2018-01-13 17:46:02,433 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xC0\x04, timestamp1515883562432 2018-01-13 17:46:02,434 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:02,434 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:02,436 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellArrayImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=480, min timestamp=1515883562430, max timestamp=1515883562432Num uniques 4; 2018-01-13 17:46:02,436 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=480 2018-01-13 17:46:02,437 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xC4\x04, timestamp1515883562436 2018-01-13 17:46:02,438 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xC5\x04, timestamp1515883562437 2018-01-13 17:46:02,439 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x85\xC6\x04, timestamp1515883562438 2018-01-13 17:46:02,440 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:02,440 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 2 segments 2018-01-13 17:46:02,441 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellArrayImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=568, min timestamp=1515883562432, max timestamp=1515883562438Num uniques 6; 2018-01-13 17:46:02,441 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=276, new segment data size=184, suffix heap size=1056,new segment heap size=568 2018-01-13 17:46:02,441 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562377.2499425c68903542ae1aa95642001803.store: column 2018-01-13 17:46:02,441 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,456 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction2Buckets[1] Thread=77 (was 75) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/f440890d-6e9a-4405-9cfb-33e8c2bbff89/WALs/hregion-56728512/hregion-56728512.1515883562379 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=410 (was 405) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1473 (was 1490) 2018-01-13 17:46:02,469 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningPipelineScanner[1] Thread=77, OpenFileDescriptor=410, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1472 2018-01-13 17:46:02,488 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,488 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,488 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/4943275c-c751-4371-b270-114f0b457b34 2018-01-13 17:46:02,489 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/4943275c-c751-4371-b270-114f0b457b34 2018-01-13 17:46:02,489 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,489 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/4943275c-c751-4371-b270-114f0b457b34 2018-01-13 17:46:02,489 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,490 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-83461159, suffix=, logDir=file:/ram4G/4943275c-c751-4371-b270-114f0b457b34/WALs/hregion-83461159, archiveDir=file:/ram4G/4943275c-c751-4371-b270-114f0b457b34/oldWALs 2018-01-13 17:46:02,497 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/4943275c-c751-4371-b270-114f0b457b34/WALs/hregion-83461159/hregion-83461159.1515883562491 2018-01-13 17:46:02,497 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,498 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/4943275c-c751-4371-b270-114f0b457b34 Table name == foobar 2018-01-13 17:46:02,509 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562489.e0110f40c2ea03e8044a535199f4dd99. 2018-01-13 17:46:02,510 DEBUG [StoreOpener-e0110f40c2ea03e8044a535199f4dd99-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,510 INFO [StoreOpener-e0110f40c2ea03e8044a535199f4dd99-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,510 INFO [StoreOpener-e0110f40c2ea03e8044a535199f4dd99-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,510 INFO [StoreOpener-e0110f40c2ea03e8044a535199f4dd99-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,511 INFO [StoreOpener-e0110f40c2ea03e8044a535199f4dd99-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,511 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562489.e0110f40c2ea03e8044a535199f4dd99. 2018-01-13 17:46:02,511 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/4943275c-c751-4371-b270-114f0b457b34/data/default/foobar/e0110f40c2ea03e8044a535199f4dd99 2018-01-13 17:46:02,511 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,517 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/4943275c-c751-4371-b270-114f0b457b34/data/default/foobar/e0110f40c2ea03e8044a535199f4dd99/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,517 INFO [Time-limited test] regionserver.HRegion(960): Onlined e0110f40c2ea03e8044a535199f4dd99; next sequenceid=2 2018-01-13 17:46:02,517 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,517 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,518 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,518 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,518 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,561 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,563 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:02,563 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store CF_TEST compacting 2 segments 2018-01-13 17:46:02,565 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=174, totalHeapSize=480, min timestamp=1, max timestamp=2Num uniques 5; 2018-01-13 17:46:02,566 ERROR [Time-limited test] regionserver.HRegion(1220): Asked to modify this region's (foobar,,1515883562489.e0110f40c2ea03e8044a535199f4dd99.) memstoreSize to a negative value which is incorrect. Current memstoreSize=0, delta=-116 java.lang.Exception at org.apache.hadoop.hbase.regionserver.HRegion.checkNegativeMemStoreDataSize(HRegion.java:1220) at org.apache.hadoop.hbase.regionserver.HRegion.addAndGetMemStoreSize(HRegion.java:1204) at org.apache.hadoop.hbase.regionserver.RegionServicesForStores.addMemStoreSize(RegionServicesForStores.java:69) at org.apache.hadoop.hbase.regionserver.CompactionPipeline.swap(CompactionPipeline.java:144) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.swapCompactedSegments(CompactingMemStore.java:315) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.doCompaction(MemStoreCompactor.java:170) at org.apache.hadoop.hbase.regionserver.MemStoreCompactor.start(MemStoreCompactor.java:103) at org.apache.hadoop.hbase.regionserver.CompactingMemStore.flushInMemory(CompactingMemStore.java:431) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.testPuttingBackChunksWithOpeningPipelineScanner(TestCompactingMemStore.java:532) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,566 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=290, new segment data size=174, suffix heap size=1112,new segment heap size=480 2018-01-13 17:46:02,567 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562489.e0110f40c2ea03e8044a535199f4dd99.store: column 2018-01-13 17:46:02,567 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=null 2018-01-13 17:46:02,570 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562489.e0110f40c2ea03e8044a535199f4dd99.store: column 2018-01-13 17:46:02,570 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=0, new segement=null 2018-01-13 17:46:02,588 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPuttingBackChunksWithOpeningPipelineScanner[1] Thread=80 (was 77) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/4943275c-c751-4371-b270-114f0b457b34/WALs/hregion-83461159/hregion-83461159.1515883562491 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=415 (was 410) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1451 (was 1472) 2018-01-13 17:46:02,600 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testSnapshotting[1] Thread=79, OpenFileDescriptor=415, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1448 2018-01-13 17:46:02,616 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,616 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,616 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c 2018-01-13 17:46:02,617 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c 2018-01-13 17:46:02,617 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,617 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c 2018-01-13 17:46:02,617 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,618 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-40965499, suffix=, logDir=file:/ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/WALs/hregion-40965499, archiveDir=file:/ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/oldWALs 2018-01-13 17:46:02,628 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/WALs/hregion-40965499/hregion-40965499.1515883562618 2018-01-13 17:46:02,628 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,628 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c Table name == foobar 2018-01-13 17:46:02,635 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d. 2018-01-13 17:46:02,636 DEBUG [StoreOpener-a910fc88142755e33ba7ce25695bee5d-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,636 INFO [StoreOpener-a910fc88142755e33ba7ce25695bee5d-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,636 INFO [StoreOpener-a910fc88142755e33ba7ce25695bee5d-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,637 INFO [StoreOpener-a910fc88142755e33ba7ce25695bee5d-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,637 INFO [StoreOpener-a910fc88142755e33ba7ce25695bee5d-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,637 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d. 2018-01-13 17:46:02,638 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/data/default/foobar/a910fc88142755e33ba7ce25695bee5d 2018-01-13 17:46:02,638 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,643 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/data/default/foobar/a910fc88142755e33ba7ce25695bee5d/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,643 INFO [Time-limited test] regionserver.HRegion(960): Onlined a910fc88142755e33ba7ce25695bee5d; next sequenceid=2 2018-01-13 17:46:02,643 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,644 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,644 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,644 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,644 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,666 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,667 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d.store: column 2018-01-13 17:46:02,668 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,668 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,669 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d.store: column 2018-01-13 17:46:02,669 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,669 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,670 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d.store: column 2018-01-13 17:46:02,670 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,670 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,671 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d.store: column 2018-01-13 17:46:02,671 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,671 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,672 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562617.a910fc88142755e33ba7ce25695bee5d.store: column 2018-01-13 17:46:02,674 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,674 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:02,687 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testSnapshotting[1] Thread=81 (was 79) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/8e5f913c-bf58-4999-8cf6-261ad191f56c/WALs/hregion-40965499/hregion-40965499.1515883562618 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=420 (was 415) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1441 (was 1448) 2018-01-13 17:46:02,700 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGet_memstoreAndSnapShot[1] Thread=81, OpenFileDescriptor=420, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1440 2018-01-13 17:46:02,718 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,718 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,718 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495 2018-01-13 17:46:02,718 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495 2018-01-13 17:46:02,718 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,719 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495 2018-01-13 17:46:02,719 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,720 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-56755370, suffix=, logDir=file:/ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/WALs/hregion-56755370, archiveDir=file:/ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/oldWALs 2018-01-13 17:46:02,780 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/WALs/hregion-56755370/hregion-56755370.1515883562720 2018-01-13 17:46:02,780 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,780 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495 Table name == foobar 2018-01-13 17:46:02,790 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562719.7148677d7934c670c23f6f9daa85b172. 2018-01-13 17:46:02,791 DEBUG [StoreOpener-7148677d7934c670c23f6f9daa85b172-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,791 INFO [StoreOpener-7148677d7934c670c23f6f9daa85b172-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,791 INFO [StoreOpener-7148677d7934c670c23f6f9daa85b172-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,791 INFO [StoreOpener-7148677d7934c670c23f6f9daa85b172-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,791 INFO [StoreOpener-7148677d7934c670c23f6f9daa85b172-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,792 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562719.7148677d7934c670c23f6f9daa85b172. 2018-01-13 17:46:02,792 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/data/default/foobar/7148677d7934c670c23f6f9daa85b172 2018-01-13 17:46:02,792 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,806 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/data/default/foobar/7148677d7934c670c23f6f9daa85b172/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,806 INFO [Time-limited test] regionserver.HRegion(960): Onlined 7148677d7934c670c23f6f9daa85b172; next sequenceid=2 2018-01-13 17:46:02,806 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,806 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,807 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,807 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,807 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,823 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,823 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:02,824 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:02,825 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=3, cellSize=174, totalHeapSize=480, min timestamp=9223372036854775807, max timestamp=9223372036854775807Num uniques 3; 2018-01-13 17:46:02,826 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=174, new segment data size=174, suffix heap size=624,new segment heap size=480 2018-01-13 17:46:02,826 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562719.7148677d7934c670c23f6f9daa85b172.store: column 2018-01-13 17:46:02,826 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,839 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGet_memstoreAndSnapShot[1] Thread=83 (was 81) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/fc4bfdf3-2b28-43eb-8fe6-897b624ee495/WALs/hregion-56755370/hregion-56755370.1515883562720 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=425 (was 420) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1367 (was 1440) 2018-01-13 17:46:02,861 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction1Bucket[1] Thread=83, OpenFileDescriptor=425, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1366 2018-01-13 17:46:02,877 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,877 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,877 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/433f466d-8464-466e-a04f-286569c0c616 2018-01-13 17:46:02,877 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/433f466d-8464-466e-a04f-286569c0c616 2018-01-13 17:46:02,877 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,877 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/433f466d-8464-466e-a04f-286569c0c616 2018-01-13 17:46:02,878 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,879 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-41406011, suffix=, logDir=file:/ram4G/433f466d-8464-466e-a04f-286569c0c616/WALs/hregion-41406011, archiveDir=file:/ram4G/433f466d-8464-466e-a04f-286569c0c616/oldWALs 2018-01-13 17:46:02,888 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/433f466d-8464-466e-a04f-286569c0c616/WALs/hregion-41406011/hregion-41406011.1515883562879 2018-01-13 17:46:02,888 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:02,888 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/433f466d-8464-466e-a04f-286569c0c616 Table name == foobar 2018-01-13 17:46:02,900 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562877.8ad6fb1569289247b2c73f1de2feda05. 2018-01-13 17:46:02,902 DEBUG [StoreOpener-8ad6fb1569289247b2c73f1de2feda05-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,902 INFO [StoreOpener-8ad6fb1569289247b2c73f1de2feda05-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,902 INFO [StoreOpener-8ad6fb1569289247b2c73f1de2feda05-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,903 INFO [StoreOpener-8ad6fb1569289247b2c73f1de2feda05-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,903 INFO [StoreOpener-8ad6fb1569289247b2c73f1de2feda05-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,903 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562877.8ad6fb1569289247b2c73f1de2feda05. 2018-01-13 17:46:02,904 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/433f466d-8464-466e-a04f-286569c0c616/data/default/foobar/8ad6fb1569289247b2c73f1de2feda05 2018-01-13 17:46:02,904 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:02,910 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/433f466d-8464-466e-a04f-286569c0c616/data/default/foobar/8ad6fb1569289247b2c73f1de2feda05/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:02,911 INFO [Time-limited test] regionserver.HRegion(960): Onlined 8ad6fb1569289247b2c73f1de2feda05; next sequenceid=2 2018-01-13 17:46:02,911 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:02,911 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,911 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:02,911 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:02,912 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:02,931 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:02,933 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x87\xB3\x04, timestamp1515883562931 2018-01-13 17:46:02,935 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x87\xB5\x04, timestamp1515883562933 2018-01-13 17:46:02,936 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x87\xB7\x04, timestamp1515883562935 2018-01-13 17:46:02,937 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x87\xB8\x04, timestamp1515883562936 2018-01-13 17:46:02,937 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:02,938 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:02,939 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellArrayImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=480, min timestamp=1515883562933, max timestamp=1515883562936Num uniques 4; 2018-01-13 17:46:02,939 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=480 2018-01-13 17:46:02,939 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562877.8ad6fb1569289247b2c73f1de2feda05.store: column 2018-01-13 17:46:02,939 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:02,952 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction1Bucket[1] Thread=85 (was 83) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/433f466d-8464-466e-a04f-286569c0c616/WALs/hregion-41406011/hregion-41406011.1515883562879 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=430 (was 425) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1353 (was 1366) 2018-01-13 17:46:02,965 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMagicCompaction3Buckets[1] Thread=85, OpenFileDescriptor=430, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1352 2018-01-13 17:46:02,987 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:02,988 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:02,988 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea 2018-01-13 17:46:02,988 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea 2018-01-13 17:46:02,988 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:02,988 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea 2018-01-13 17:46:02,989 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:02,992 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-78032566, suffix=, logDir=file:/ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/WALs/hregion-78032566, archiveDir=file:/ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/oldWALs 2018-01-13 17:46:03,005 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/WALs/hregion-78032566/hregion-78032566.1515883562993 2018-01-13 17:46:03,005 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,005 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea Table name == foobar 2018-01-13 17:46:03,032 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883562989.1a8b56f6566dafb23a0779d4d85164a6. 2018-01-13 17:46:03,034 DEBUG [StoreOpener-1a8b56f6566dafb23a0779d4d85164a6-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,035 INFO [StoreOpener-1a8b56f6566dafb23a0779d4d85164a6-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,035 INFO [StoreOpener-1a8b56f6566dafb23a0779d4d85164a6-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,035 INFO [StoreOpener-1a8b56f6566dafb23a0779d4d85164a6-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,035 INFO [StoreOpener-1a8b56f6566dafb23a0779d4d85164a6-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,037 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883562989.1a8b56f6566dafb23a0779d4d85164a6. 2018-01-13 17:46:03,037 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/data/default/foobar/1a8b56f6566dafb23a0779d4d85164a6 2018-01-13 17:46:03,037 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,045 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/data/default/foobar/1a8b56f6566dafb23a0779d4d85164a6/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,045 INFO [Time-limited test] regionserver.HRegion(960): Onlined 1a8b56f6566dafb23a0779d4d85164a6; next sequenceid=2 2018-01-13 17:46:03,045 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,046 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,046 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,046 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,046 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,073 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,075 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88A\x04, timestamp:1515883563073 2018-01-13 17:46:03,076 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88C\x04, timestamp:1515883563075 2018-01-13 17:46:03,077 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88D\x04, timestamp:1515883563076 2018-01-13 17:46:03,077 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,077 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:03,078 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=576, min timestamp=1515883563073, max timestamp=1515883563076Num uniques -1; flattened 2018-01-13 17:46:03,080 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88F\x04, timestamp:1515883563078 2018-01-13 17:46:03,080 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,080 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(94): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; flattening a segment 2018-01-13 17:46:03,082 DEBUG [Time-limited test] regionserver.CompactionPipeline(206): Compaction pipeline segment Type=CSLMImmutableSegment, empty=no, cellCount=1, cellSize=46, totalHeapSize=336, min timestamp=1515883563078, max timestamp=1515883563078Num uniques -1; flattened 2018-01-13 17:46:03,084 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88J\x04, timestamp:1515883563082 2018-01-13 17:46:03,085 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88L\x04, timestamp:1515883563084 2018-01-13 17:46:03,087 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88N\x04, timestamp:1515883563086 2018-01-13 17:46:03,088 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88O\x04, timestamp:1515883563087 2018-01-13 17:46:03,088 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,089 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(88): ADAPTIVE (compaction probability=0.5) in-memory compaction of CF_TEST; merging 3 segments 2018-01-13 17:46:03,089 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=8, cellSize=368, totalHeapSize=792, min timestamp=1515883563073, max timestamp=1515883563087Num uniques 4; 2018-01-13 17:46:03,090 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=368, new segment data size=368, suffix heap size=1400,new segment heap size=792 2018-01-13 17:46:03,091 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88R\x04, timestamp:1515883563090 2018-01-13 17:46:03,094 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88T\x04, timestamp:1515883563092 2018-01-13 17:46:03,096 DEBUG [Time-limited test] regionserver.TestCompactingMemStore(833): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x88V\x04, timestamp:1515883563094 2018-01-13 17:46:03,096 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,096 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): ADAPTIVE (compaction probability=0.5) memory compaction for store CF_TEST compacting 2 segments 2018-01-13 17:46:03,099 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=2, new segement=Type=CellChunkImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=504, min timestamp=1515883563084, max timestamp=1515883563094Num uniques 11; 2018-01-13 17:46:03,099 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=506, new segment data size=184, suffix heap size=1368,new segment heap size=504 2018-01-13 17:46:03,100 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883562989.1a8b56f6566dafb23a0779d4d85164a6.store: column 2018-01-13 17:46:03,100 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:03,123 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMagicCompaction3Buckets[1] Thread=88 (was 85) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/7f158b38-d846-4de9-b781-82dad6bae0ea/WALs/hregion-78032566/hregion-78032566.1515883562993 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=435 (was 430) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1344 (was 1352) 2018-01-13 17:46:03,140 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction3Buckets[1] Thread=87, OpenFileDescriptor=437, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1341 2018-01-13 17:46:03,185 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,186 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,186 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc 2018-01-13 17:46:03,186 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc 2018-01-13 17:46:03,186 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,186 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc 2018-01-13 17:46:03,187 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,188 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-57725088, suffix=, logDir=file:/ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/WALs/hregion-57725088, archiveDir=file:/ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/oldWALs 2018-01-13 17:46:03,226 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/WALs/hregion-57725088/hregion-57725088.1515883563204 2018-01-13 17:46:03,226 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,227 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc Table name == foobar 2018-01-13 17:46:03,233 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563186.7894172a6f699a975022babffbb35a43. 2018-01-13 17:46:03,234 DEBUG [StoreOpener-7894172a6f699a975022babffbb35a43-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,234 INFO [StoreOpener-7894172a6f699a975022babffbb35a43-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,234 INFO [StoreOpener-7894172a6f699a975022babffbb35a43-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,235 INFO [StoreOpener-7894172a6f699a975022babffbb35a43-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,235 INFO [StoreOpener-7894172a6f699a975022babffbb35a43-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,235 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563186.7894172a6f699a975022babffbb35a43. 2018-01-13 17:46:03,236 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/data/default/foobar/7894172a6f699a975022babffbb35a43 2018-01-13 17:46:03,236 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,242 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/data/default/foobar/7894172a6f699a975022babffbb35a43/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,243 INFO [Time-limited test] regionserver.HRegion(960): Onlined 7894172a6f699a975022babffbb35a43; next sequenceid=2 2018-01-13 17:46:03,243 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,243 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,243 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,244 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,244 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,266 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,268 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x02\x04, timestamp1515883563266 2018-01-13 17:46:03,269 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x04\x04, timestamp1515883563268 2018-01-13 17:46:03,271 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x05\x04, timestamp1515883563269 2018-01-13 17:46:03,272 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01C\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x07\x04, timestamp1515883563271 2018-01-13 17:46:03,272 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,272 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 1 segments 2018-01-13 17:46:03,273 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=Type=CellArrayImmutableSegment, empty=no, cellCount=3, cellSize=138, totalHeapSize=480, min timestamp=1515883563268, max timestamp=1515883563271Num uniques 4; 2018-01-13 17:46:03,274 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=184, new segment data size=138, suffix heap size=696,new segment heap size=480 2018-01-13 17:46:03,275 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01A\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x0A\x04, timestamp1515883563274 2018-01-13 17:46:03,277 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x0C\x04, timestamp1515883563276 2018-01-13 17:46:03,278 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x0D\x04, timestamp1515883563277 2018-01-13 17:46:03,280 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01D\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x0E\x04, timestamp1515883563278 2018-01-13 17:46:03,282 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x10\x04, timestamp1515883563280 2018-01-13 17:46:03,283 DEBUG [Time-limited test] regionserver.TestCompactingToCellFlatMapMemStore(830): added kv: \x00\x01B\x0Atestfamilytestqualifier\x00\x00\x01`\xF1\xB3\x89\x12\x04, timestamp1515883563282 2018-01-13 17:46:03,283 DEBUG [Time-limited test] regionserver.MemStoreCompactor(95): Starting In-Memory Compaction of column 2018-01-13 17:46:03,283 DEBUG [Time-limited test] regionserver.MemStoreCompactionStrategy(108): EAGER memory compaction for store column compacting 3 segments 2018-01-13 17:46:03,284 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=3, new segement=Type=CellArrayImmutableSegment, empty=no, cellCount=4, cellSize=184, totalHeapSize=568, min timestamp=1515883563271, max timestamp=1515883563282Num uniques 9; 2018-01-13 17:46:03,285 DEBUG [Time-limited test] regionserver.CompactionPipeline(145): Suffix data size=414, new segment data size=184, suffix heap size=1632,new segment heap size=568 2018-01-13 17:46:03,285 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883563186.7894172a6f699a975022babffbb35a43.store: column 2018-01-13 17:46:03,285 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:03,298 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testCompaction3Buckets[1] Thread=89 (was 87) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/ea827e8f-7997-4266-abb6-1b6d87704bcc/WALs/hregion-57725088/hregion-57725088.1515883563204 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=440 (was 437) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1325 (was 1341) 2018-01-13 17:46:03,312 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot2[1] Thread=89, OpenFileDescriptor=440, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1325 2018-01-13 17:46:03,348 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,349 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,349 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b 2018-01-13 17:46:03,349 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b 2018-01-13 17:46:03,349 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,349 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b 2018-01-13 17:46:03,350 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,351 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-08352376, suffix=, logDir=file:/ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/WALs/hregion-08352376, archiveDir=file:/ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/oldWALs 2018-01-13 17:46:03,374 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/WALs/hregion-08352376/hregion-08352376.1515883563352 2018-01-13 17:46:03,375 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,375 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b Table name == foobar 2018-01-13 17:46:03,381 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563349.49fe7b195c453be47ac459894cb0e9fb. 2018-01-13 17:46:03,384 DEBUG [StoreOpener-49fe7b195c453be47ac459894cb0e9fb-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,385 INFO [StoreOpener-49fe7b195c453be47ac459894cb0e9fb-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,385 INFO [StoreOpener-49fe7b195c453be47ac459894cb0e9fb-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,385 INFO [StoreOpener-49fe7b195c453be47ac459894cb0e9fb-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,385 INFO [StoreOpener-49fe7b195c453be47ac459894cb0e9fb-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,386 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563349.49fe7b195c453be47ac459894cb0e9fb. 2018-01-13 17:46:03,386 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/data/default/foobar/49fe7b195c453be47ac459894cb0e9fb 2018-01-13 17:46:03,386 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,402 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/data/default/foobar/49fe7b195c453be47ac459894cb0e9fb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,402 INFO [Time-limited test] regionserver.HRegion(960): Onlined 49fe7b195c453be47ac459894cb0e9fb; next sequenceid=2 2018-01-13 17:46:03,402 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,403 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,403 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,403 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,403 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,425 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,426 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883563349.49fe7b195c453be47ac459894cb0e9fb.store: column 2018-01-13 17:46:03,427 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:03,450 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,451 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883563349.49fe7b195c453be47ac459894cb0e9fb.store: column 2018-01-13 17:46:03,451 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:03,471 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot2[1] Thread=92 (was 89) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/65a1b3d7-e6ac-4009-a249-557fed35988b/WALs/hregion-08352376/hregion-08352376.1515883563352 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=445 (was 440) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1324 (was 1325) 2018-01-13 17:46:03,501 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteColumn[1] Thread=91, OpenFileDescriptor=447, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1323 2018-01-13 17:46:03,524 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,524 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,524 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18 2018-01-13 17:46:03,524 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18 2018-01-13 17:46:03,525 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,527 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18 2018-01-13 17:46:03,528 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,529 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-13116802, suffix=, logDir=file:/ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/WALs/hregion-13116802, archiveDir=file:/ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/oldWALs 2018-01-13 17:46:03,554 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/WALs/hregion-13116802/hregion-13116802.1515883563530 2018-01-13 17:46:03,554 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,554 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18 Table name == foobar 2018-01-13 17:46:03,563 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563527.d0948f28247b15ab4646a9d7cbe0e216. 2018-01-13 17:46:03,563 DEBUG [StoreOpener-d0948f28247b15ab4646a9d7cbe0e216-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,564 INFO [StoreOpener-d0948f28247b15ab4646a9d7cbe0e216-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,564 INFO [StoreOpener-d0948f28247b15ab4646a9d7cbe0e216-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,564 INFO [StoreOpener-d0948f28247b15ab4646a9d7cbe0e216-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,564 INFO [StoreOpener-d0948f28247b15ab4646a9d7cbe0e216-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,565 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563527.d0948f28247b15ab4646a9d7cbe0e216. 2018-01-13 17:46:03,565 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/data/default/foobar/d0948f28247b15ab4646a9d7cbe0e216 2018-01-13 17:46:03,565 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,572 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/data/default/foobar/d0948f28247b15ab4646a9d7cbe0e216/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,572 INFO [Time-limited test] regionserver.HRegion(960): Onlined d0948f28247b15ab4646a9d7cbe0e216; next sequenceid=2 2018-01-13 17:46:03,572 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,573 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,573 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,573 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,573 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,593 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,607 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteColumn[1] Thread=93 (was 91) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/923ee0ea-5345-450f-b3e7-9932ea144b18/WALs/hregion-13116802/hregion-13116802.1515883563530 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=450 (was 447) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1284 (was 1323) 2018-01-13 17:46:03,635 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteFamily[1] Thread=93, OpenFileDescriptor=450, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1284 2018-01-13 17:46:03,652 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,652 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,652 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f 2018-01-13 17:46:03,652 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f 2018-01-13 17:46:03,652 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,652 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f 2018-01-13 17:46:03,653 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,653 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-88514233, suffix=, logDir=file:/ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/WALs/hregion-88514233, archiveDir=file:/ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/oldWALs 2018-01-13 17:46:03,660 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/WALs/hregion-88514233/hregion-88514233.1515883563654 2018-01-13 17:46:03,660 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,660 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f Table name == foobar 2018-01-13 17:46:03,667 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563652.1fe7008fa53253920d3cb09e9c331863. 2018-01-13 17:46:03,668 DEBUG [StoreOpener-1fe7008fa53253920d3cb09e9c331863-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,668 INFO [StoreOpener-1fe7008fa53253920d3cb09e9c331863-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,668 INFO [StoreOpener-1fe7008fa53253920d3cb09e9c331863-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,669 INFO [StoreOpener-1fe7008fa53253920d3cb09e9c331863-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,669 INFO [StoreOpener-1fe7008fa53253920d3cb09e9c331863-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,670 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563652.1fe7008fa53253920d3cb09e9c331863. 2018-01-13 17:46:03,670 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/data/default/foobar/1fe7008fa53253920d3cb09e9c331863 2018-01-13 17:46:03,671 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,680 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/data/default/foobar/1fe7008fa53253920d3cb09e9c331863/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,680 INFO [Time-limited test] regionserver.HRegion(960): Onlined 1fe7008fa53253920d3cb09e9c331863; next sequenceid=2 2018-01-13 17:46:03,680 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,681 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,681 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,681 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,682 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,699 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,714 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteFamily[1] Thread=95 (was 93) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/f86f5467-cf05-42ae-9801-c5f40ee2e97f/WALs/hregion-88514233/hregion-88514233.1515883563654 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=455 (was 450) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1278 (was 1284) 2018-01-13 17:46:03,727 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlushMeta[1] Thread=95, OpenFileDescriptor=457, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1278 2018-01-13 17:46:03,744 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,744 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,744 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b 2018-01-13 17:46:03,745 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b 2018-01-13 17:46:03,745 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,745 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b 2018-01-13 17:46:03,745 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,746 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-09436166, suffix=, logDir=file:/ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/WALs/hregion-09436166, archiveDir=file:/ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/oldWALs 2018-01-13 17:46:03,755 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/WALs/hregion-09436166/hregion-09436166.1515883563747 2018-01-13 17:46:03,755 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,755 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b Table name == foobar 2018-01-13 17:46:03,767 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563745.aeebd1c506a170567f2389c246885764. 2018-01-13 17:46:03,768 DEBUG [StoreOpener-aeebd1c506a170567f2389c246885764-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,769 INFO [StoreOpener-aeebd1c506a170567f2389c246885764-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,769 INFO [StoreOpener-aeebd1c506a170567f2389c246885764-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,769 INFO [StoreOpener-aeebd1c506a170567f2389c246885764-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,769 INFO [StoreOpener-aeebd1c506a170567f2389c246885764-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,770 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563745.aeebd1c506a170567f2389c246885764. 2018-01-13 17:46:03,770 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/data/default/foobar/aeebd1c506a170567f2389c246885764 2018-01-13 17:46:03,771 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,778 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/data/default/foobar/aeebd1c506a170567f2389c246885764/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,778 INFO [Time-limited test] regionserver.HRegion(960): Onlined aeebd1c506a170567f2389c246885764; next sequenceid=2 2018-01-13 17:46:03,778 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,779 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,779 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,779 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,779 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,799 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,814 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,814 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/88b41629-b462-4161-94db-c808a527aa35 2018-01-13 17:46:03,814 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/88b41629-b462-4161-94db-c808a527aa35 2018-01-13 17:46:03,814 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,814 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/88b41629-b462-4161-94db-c808a527aa35 2018-01-13 17:46:03,815 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,815 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,816 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=1234.meta, suffix=.meta, logDir=file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234, archiveDir=file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/oldWALs 2018-01-13 17:46:03,822 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234/1234.meta.1515883563816.meta 2018-01-13 17:46:03,822 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,823 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_barrier', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_meta', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'rep_position', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'}, {NAME => 'table', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = /ram4G/88b41629-b462-4161-94db-c808a527aa35 Table name == hbase:meta 2018-01-13 17:46:03,830 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated hbase:meta,,1.1588230740 2018-01-13 17:46:03,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,831 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:46:03,831 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,832 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:46:03,833 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,834 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:46:03,834 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_meta: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,834 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:46:03,835 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_position: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.DefaultMemStore 2018-01-13 17:46:03,836 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,836 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/88b41629-b462-4161-94db-c808a527aa35/data/hbase/meta/1588230740 2018-01-13 17:46:03,837 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushSize/# of families (25,6M)) instead. 2018-01-13 17:46:03,848 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/88b41629-b462-4161-94db-c808a527aa35/data/hbase/meta/1588230740/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,848 INFO [Time-limited test] regionserver.HRegion(960): Onlined 1588230740; next sequenceid=2 2018-01-13 17:46:03,849 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=1234, suffix=, logDir=file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234, archiveDir=file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/oldWALs 2018-01-13 17:46:03,868 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234/1234.1515883563850 2018-01-13 17:46:03,868 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,868 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion testShouldFlushMeta_1_ HTD == 'testShouldFlushMeta_1_', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/88b41629-b462-4161-94db-c808a527aa35 Table name == testShouldFlushMeta_1_ 2018-01-13 17:46:03,882 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated testShouldFlushMeta_1_,row_0200,1515883563848.e559fbf695259a6883add183e3fa3303. 2018-01-13 17:46:03,889 DEBUG [StoreOpener-e559fbf695259a6883add183e3fa3303-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,891 INFO [StoreOpener-e559fbf695259a6883add183e3fa3303-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,891 INFO [StoreOpener-e559fbf695259a6883add183e3fa3303-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,891 INFO [StoreOpener-e559fbf695259a6883add183e3fa3303-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,891 INFO [StoreOpener-e559fbf695259a6883add183e3fa3303-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,892 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=testShouldFlushMeta_1_,row_0200,1515883563848.e559fbf695259a6883add183e3fa3303. 2018-01-13 17:46:03,892 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/88b41629-b462-4161-94db-c808a527aa35/data/default/testShouldFlushMeta_1_/e559fbf695259a6883add183e3fa3303 2018-01-13 17:46:03,892 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testShouldFlushMeta_1_ descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,900 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/88b41629-b462-4161-94db-c808a527aa35/data/default/testShouldFlushMeta_1_/e559fbf695259a6883add183e3fa3303/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,900 INFO [Time-limited test] regionserver.HRegion(960): Onlined e559fbf695259a6883add183e3fa3303; next sequenceid=2 2018-01-13 17:46:03,927 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlushMeta[1] Thread=101 (was 95) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/8cfde5e9-88b8-4f0e-a507-6cc12c4e126b/WALs/hregion-09436166/hregion-09436166.1515883563747 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234/1234.meta.1515883563816.meta sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/88b41629-b462-4161-94db-c808a527aa35/WALs/1234/1234.1515883563850 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=470 (was 457) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=200 (was 199) - ProcessCount LEAK? -, AvailableMemoryMB=1272 (was 1278) 2018-01-13 17:46:03,941 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreEditsVisibilityWithSameKey[1] Thread=101, OpenFileDescriptor=470, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1271 2018-01-13 17:46:03,956 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:03,957 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:03,957 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304 2018-01-13 17:46:03,957 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304 2018-01-13 17:46:03,957 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:03,957 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304 2018-01-13 17:46:03,958 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:03,958 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-01273827, suffix=, logDir=file:/ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/WALs/hregion-01273827, archiveDir=file:/ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/oldWALs 2018-01-13 17:46:03,965 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/WALs/hregion-01273827/hregion-01273827.1515883563959 2018-01-13 17:46:03,965 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:03,965 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304 Table name == foobar 2018-01-13 17:46:03,972 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883563957.5d8f7d03ea8571b5d6f6af752bff578a. 2018-01-13 17:46:03,973 DEBUG [StoreOpener-5d8f7d03ea8571b5d6f6af752bff578a-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,974 INFO [StoreOpener-5d8f7d03ea8571b5d6f6af752bff578a-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,974 INFO [StoreOpener-5d8f7d03ea8571b5d6f6af752bff578a-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,974 INFO [StoreOpener-5d8f7d03ea8571b5d6f6af752bff578a-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,974 INFO [StoreOpener-5d8f7d03ea8571b5d6f6af752bff578a-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:03,975 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883563957.5d8f7d03ea8571b5d6f6af752bff578a. 2018-01-13 17:46:03,975 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/data/default/foobar/5d8f7d03ea8571b5d6f6af752bff578a 2018-01-13 17:46:03,975 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:03,980 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/data/default/foobar/5d8f7d03ea8571b5d6f6af752bff578a/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:03,980 INFO [Time-limited test] regionserver.HRegion(960): Onlined 5d8f7d03ea8571b5d6f6af752bff578a; next sequenceid=2 2018-01-13 17:46:03,980 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:03,981 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:03,981 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:03,981 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:03,982 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,001 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,015 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreEditsVisibilityWithSameKey[1] Thread=104 (was 101) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/5faf8aa2-30ae-40ff-a3b3-e0abae373304/WALs/hregion-01273827/hregion-01273827.1515883563959 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=475 (was 470) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1266 (was 1271) 2018-01-13 17:46:04,031 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testKeepDeleteInmemstore[1] Thread=103, OpenFileDescriptor=475, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1265 2018-01-13 17:46:04,046 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,046 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,046 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e8177143-ac99-4355-893d-2db663983b2e 2018-01-13 17:46:04,046 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e8177143-ac99-4355-893d-2db663983b2e 2018-01-13 17:46:04,046 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,046 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e8177143-ac99-4355-893d-2db663983b2e 2018-01-13 17:46:04,047 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,047 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-17284723, suffix=, logDir=file:/ram4G/e8177143-ac99-4355-893d-2db663983b2e/WALs/hregion-17284723, archiveDir=file:/ram4G/e8177143-ac99-4355-893d-2db663983b2e/oldWALs 2018-01-13 17:46:04,054 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e8177143-ac99-4355-893d-2db663983b2e/WALs/hregion-17284723/hregion-17284723.1515883564047 2018-01-13 17:46:04,055 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,055 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e8177143-ac99-4355-893d-2db663983b2e Table name == foobar 2018-01-13 17:46:04,067 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564046.9919333d9058cea371ca0a17b045af11. 2018-01-13 17:46:04,068 DEBUG [StoreOpener-9919333d9058cea371ca0a17b045af11-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,068 INFO [StoreOpener-9919333d9058cea371ca0a17b045af11-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,068 INFO [StoreOpener-9919333d9058cea371ca0a17b045af11-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,068 INFO [StoreOpener-9919333d9058cea371ca0a17b045af11-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,068 INFO [StoreOpener-9919333d9058cea371ca0a17b045af11-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,069 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564046.9919333d9058cea371ca0a17b045af11. 2018-01-13 17:46:04,069 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e8177143-ac99-4355-893d-2db663983b2e/data/default/foobar/9919333d9058cea371ca0a17b045af11 2018-01-13 17:46:04,069 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,076 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e8177143-ac99-4355-893d-2db663983b2e/data/default/foobar/9919333d9058cea371ca0a17b045af11/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,076 INFO [Time-limited test] regionserver.HRegion(960): Onlined 9919333d9058cea371ca0a17b045af11; next sequenceid=2 2018-01-13 17:46:04,076 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,077 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,077 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,077 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,077 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,112 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,127 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testKeepDeleteInmemstore[1] Thread=106 (was 103) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/e8177143-ac99-4355-893d-2db663983b2e/WALs/hregion-17284723/hregion-17284723.1515883564047 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=480 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1261 (was 1265) 2018-01-13 17:46:04,141 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlush[1] Thread=105, OpenFileDescriptor=480, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1260 2018-01-13 17:46:04,160 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,160 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,160 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f 2018-01-13 17:46:04,160 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f 2018-01-13 17:46:04,160 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,160 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f 2018-01-13 17:46:04,160 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,161 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-40156867, suffix=, logDir=file:/ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/WALs/hregion-40156867, archiveDir=file:/ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/oldWALs 2018-01-13 17:46:04,168 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/WALs/hregion-40156867/hregion-40156867.1515883564162 2018-01-13 17:46:04,168 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,168 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f Table name == foobar 2018-01-13 17:46:04,175 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564160.8377aba1913987de41f2141d2f02c242. 2018-01-13 17:46:04,176 DEBUG [StoreOpener-8377aba1913987de41f2141d2f02c242-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,177 INFO [StoreOpener-8377aba1913987de41f2141d2f02c242-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,177 INFO [StoreOpener-8377aba1913987de41f2141d2f02c242-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,177 INFO [StoreOpener-8377aba1913987de41f2141d2f02c242-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,178 INFO [StoreOpener-8377aba1913987de41f2141d2f02c242-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,178 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564160.8377aba1913987de41f2141d2f02c242. 2018-01-13 17:46:04,178 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/data/default/foobar/8377aba1913987de41f2141d2f02c242 2018-01-13 17:46:04,179 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,191 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/data/default/foobar/8377aba1913987de41f2141d2f02c242/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,191 INFO [Time-limited test] regionserver.HRegion(960): Onlined 8377aba1913987de41f2141d2f02c242; next sequenceid=2 2018-01-13 17:46:04,191 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,192 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,192 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,192 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,192 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,208 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,221 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,221 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,221 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9 2018-01-13 17:46:04,221 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9 2018-01-13 17:46:04,221 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,221 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9 2018-01-13 17:46:04,222 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,223 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-88270304, suffix=, logDir=file:/ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/WALs/hregion-88270304, archiveDir=file:/ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/oldWALs 2018-01-13 17:46:04,229 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/WALs/hregion-88270304/hregion-88270304.1515883564223 2018-01-13 17:46:04,229 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,229 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9 Table name == foobar 2018-01-13 17:46:04,236 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564222.4fadfd3857212d0d8713a2926887be7c. 2018-01-13 17:46:04,237 DEBUG [StoreOpener-4fadfd3857212d0d8713a2926887be7c-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,237 INFO [StoreOpener-4fadfd3857212d0d8713a2926887be7c-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,238 INFO [StoreOpener-4fadfd3857212d0d8713a2926887be7c-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,238 INFO [StoreOpener-4fadfd3857212d0d8713a2926887be7c-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,238 INFO [StoreOpener-4fadfd3857212d0d8713a2926887be7c-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,238 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564222.4fadfd3857212d0d8713a2926887be7c. 2018-01-13 17:46:04,239 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/data/default/foobar/4fadfd3857212d0d8713a2926887be7c 2018-01-13 17:46:04,239 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,245 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/data/default/foobar/4fadfd3857212d0d8713a2926887be7c/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,245 INFO [Time-limited test] regionserver.HRegion(960): Onlined 4fadfd3857212d0d8713a2926887be7c; next sequenceid=2 2018-01-13 17:46:04,247 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd 2018-01-13 17:46:04,247 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd 2018-01-13 17:46:04,247 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd 2018-01-13 17:46:04,248 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,249 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-80105858, suffix=, logDir=file:/ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/WALs/hregion-80105858, archiveDir=file:/ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/oldWALs 2018-01-13 17:46:04,258 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/WALs/hregion-80105858/hregion-80105858.1515883564249 2018-01-13 17:46:04,259 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,259 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'foo', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd Table name == foobar 2018-01-13 17:46:04,268 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564247.abf5a77bd5b67d25726b76ad092c13f6. 2018-01-13 17:46:04,269 DEBUG [StoreOpener-abf5a77bd5b67d25726b76ad092c13f6-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,269 INFO [StoreOpener-abf5a77bd5b67d25726b76ad092c13f6-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,269 INFO [StoreOpener-abf5a77bd5b67d25726b76ad092c13f6-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,269 INFO [StoreOpener-abf5a77bd5b67d25726b76ad092c13f6-1] hfile.CacheConfig(239): Created cacheConfig for foo: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,270 INFO [StoreOpener-abf5a77bd5b67d25726b76ad092c13f6-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,270 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564247.abf5a77bd5b67d25726b76ad092c13f6. 2018-01-13 17:46:04,270 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/data/default/foobar/abf5a77bd5b67d25726b76ad092c13f6 2018-01-13 17:46:04,271 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,278 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/data/default/foobar/abf5a77bd5b67d25726b76ad092c13f6/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,278 INFO [Time-limited test] regionserver.HRegion(960): Onlined abf5a77bd5b67d25726b76ad092c13f6; next sequenceid=2 2018-01-13 17:46:04,295 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testShouldFlush[1] Thread=111 (was 105) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/b24506a4-f310-4e75-aefc-4aac967780e9/WALs/hregion-88270304/hregion-88270304.1515883564223 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/688bd53a-d732-4be2-bb5b-6d36edad842f/WALs/hregion-40156867/hregion-40156867.1515883564162 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/70d6212b-4501-488b-b3c1-31d3f30645dd/WALs/hregion-80105858/hregion-80105858.1515883564249 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=495 (was 480) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1247 (was 1260) 2018-01-13 17:46:04,310 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDelete[1] Thread=111, OpenFileDescriptor=495, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1245 2018-01-13 17:46:04,324 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,324 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,324 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e 2018-01-13 17:46:04,324 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e 2018-01-13 17:46:04,325 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,325 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e 2018-01-13 17:46:04,325 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,326 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-61502296, suffix=, logDir=file:/ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/WALs/hregion-61502296, archiveDir=file:/ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/oldWALs 2018-01-13 17:46:04,332 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/WALs/hregion-61502296/hregion-61502296.1515883564326 2018-01-13 17:46:04,332 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,332 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e Table name == foobar 2018-01-13 17:46:04,338 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564325.9824a1e2c592ecf6ff490b6f3eb2b997. 2018-01-13 17:46:04,338 DEBUG [StoreOpener-9824a1e2c592ecf6ff490b6f3eb2b997-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,339 INFO [StoreOpener-9824a1e2c592ecf6ff490b6f3eb2b997-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,339 INFO [StoreOpener-9824a1e2c592ecf6ff490b6f3eb2b997-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,339 INFO [StoreOpener-9824a1e2c592ecf6ff490b6f3eb2b997-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,339 INFO [StoreOpener-9824a1e2c592ecf6ff490b6f3eb2b997-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,340 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564325.9824a1e2c592ecf6ff490b6f3eb2b997. 2018-01-13 17:46:04,340 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/data/default/foobar/9824a1e2c592ecf6ff490b6f3eb2b997 2018-01-13 17:46:04,340 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,349 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/data/default/foobar/9824a1e2c592ecf6ff490b6f3eb2b997/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,349 INFO [Time-limited test] regionserver.HRegion(960): Onlined 9824a1e2c592ecf6ff490b6f3eb2b997; next sequenceid=2 2018-01-13 17:46:04,349 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,350 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,350 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,350 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,350 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,367 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,382 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDelete[1] Thread=113 (was 111) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/fc7fea12-84ce-45b2-9256-90d424cd832e/WALs/hregion-61502296/hregion-61502296.1515883564326 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=500 (was 495) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1024 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1237 (was 1245) 2018-01-13 17:46:04,397 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteColumn[1] Thread=113, OpenFileDescriptor=502, MaxFileDescriptor=1048576, SystemLoadAverage=1024, ProcessCount=199, AvailableMemoryMB=1236 2018-01-13 17:46:04,416 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,416 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,417 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2 2018-01-13 17:46:04,417 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2 2018-01-13 17:46:04,417 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,417 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2 2018-01-13 17:46:04,417 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,419 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-36315603, suffix=, logDir=file:/ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/WALs/hregion-36315603, archiveDir=file:/ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/oldWALs 2018-01-13 17:46:04,457 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/WALs/hregion-36315603/hregion-36315603.1515883564419 2018-01-13 17:46:04,457 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,457 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2 Table name == foobar 2018-01-13 17:46:04,466 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564417.e209218d40cd88dfe8067d983ec366bb. 2018-01-13 17:46:04,468 DEBUG [StoreOpener-e209218d40cd88dfe8067d983ec366bb-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,468 INFO [StoreOpener-e209218d40cd88dfe8067d983ec366bb-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,468 INFO [StoreOpener-e209218d40cd88dfe8067d983ec366bb-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,469 INFO [StoreOpener-e209218d40cd88dfe8067d983ec366bb-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,469 INFO [StoreOpener-e209218d40cd88dfe8067d983ec366bb-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,469 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564417.e209218d40cd88dfe8067d983ec366bb. 2018-01-13 17:46:04,470 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/data/default/foobar/e209218d40cd88dfe8067d983ec366bb 2018-01-13 17:46:04,470 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,476 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/data/default/foobar/e209218d40cd88dfe8067d983ec366bb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,476 INFO [Time-limited test] regionserver.HRegion(960): Onlined e209218d40cd88dfe8067d983ec366bb; next sequenceid=2 2018-01-13 17:46:04,477 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,477 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,477 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,478 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,478 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,499 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,514 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteColumn[1] Thread=115 (was 113) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/20a073c5-a3c2-4038-b33c-195ce4f5afb2/WALs/hregion-36315603/hregion-36315603.1515883564419 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=505 (was 502) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1024), ProcessCount=199 (was 199), AvailableMemoryMB=1224 (was 1236) 2018-01-13 17:46:04,526 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteFamily[1] Thread=115, OpenFileDescriptor=505, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=1223 2018-01-13 17:46:04,551 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,551 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,551 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/b9888c52-a699-48bb-a919-66105ef601de 2018-01-13 17:46:04,551 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/b9888c52-a699-48bb-a919-66105ef601de 2018-01-13 17:46:04,551 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,552 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/b9888c52-a699-48bb-a919-66105ef601de 2018-01-13 17:46:04,558 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,559 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-14005105, suffix=, logDir=file:/ram4G/b9888c52-a699-48bb-a919-66105ef601de/WALs/hregion-14005105, archiveDir=file:/ram4G/b9888c52-a699-48bb-a919-66105ef601de/oldWALs 2018-01-13 17:46:04,568 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/b9888c52-a699-48bb-a919-66105ef601de/WALs/hregion-14005105/hregion-14005105.1515883564560 2018-01-13 17:46:04,568 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,568 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/b9888c52-a699-48bb-a919-66105ef601de Table name == foobar 2018-01-13 17:46:04,574 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564552.b58491e7ebfad225e77b76a80cb25459. 2018-01-13 17:46:04,575 DEBUG [StoreOpener-b58491e7ebfad225e77b76a80cb25459-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,575 INFO [StoreOpener-b58491e7ebfad225e77b76a80cb25459-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,575 INFO [StoreOpener-b58491e7ebfad225e77b76a80cb25459-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,575 INFO [StoreOpener-b58491e7ebfad225e77b76a80cb25459-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,576 INFO [StoreOpener-b58491e7ebfad225e77b76a80cb25459-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,576 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564552.b58491e7ebfad225e77b76a80cb25459. 2018-01-13 17:46:04,576 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/b9888c52-a699-48bb-a919-66105ef601de/data/default/foobar/b58491e7ebfad225e77b76a80cb25459 2018-01-13 17:46:04,577 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,582 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/b9888c52-a699-48bb-a919-66105ef601de/data/default/foobar/b58491e7ebfad225e77b76a80cb25459/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,583 INFO [Time-limited test] regionserver.HRegion(960): Onlined b58491e7ebfad225e77b76a80cb25459; next sequenceid=2 2018-01-13 17:46:04,583 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,583 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,583 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,584 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,584 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,615 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,630 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testGetWithDeleteFamily[1] Thread=118 (was 115) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/b9888c52-a699-48bb-a919-66105ef601de/WALs/hregion-14005105/hregion-14005105.1515883564560 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=510 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=1193 (was 1223) 2018-01-13 17:46:04,643 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot[1] Thread=117, OpenFileDescriptor=510, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=1192 2018-01-13 17:46:04,659 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,659 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,659 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6 2018-01-13 17:46:04,659 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6 2018-01-13 17:46:04,659 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,659 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6 2018-01-13 17:46:04,660 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,661 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-13621429, suffix=, logDir=file:/ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6/WALs/hregion-13621429, archiveDir=file:/ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6/oldWALs 2018-01-13 17:46:04,669 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6/WALs/hregion-13621429/hregion-13621429.1515883564661 2018-01-13 17:46:04,669 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,669 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6 Table name == foobar 2018-01-13 17:46:04,676 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564659.2b2262bc8ae16e14a97d7b5693e80fbb. 2018-01-13 17:46:04,677 DEBUG [StoreOpener-2b2262bc8ae16e14a97d7b5693e80fbb-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,677 INFO [StoreOpener-2b2262bc8ae16e14a97d7b5693e80fbb-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,677 INFO [StoreOpener-2b2262bc8ae16e14a97d7b5693e80fbb-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,677 INFO [StoreOpener-2b2262bc8ae16e14a97d7b5693e80fbb-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,678 INFO [StoreOpener-2b2262bc8ae16e14a97d7b5693e80fbb-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,678 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564659.2b2262bc8ae16e14a97d7b5693e80fbb. 2018-01-13 17:46:04,678 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6/data/default/foobar/2b2262bc8ae16e14a97d7b5693e80fbb 2018-01-13 17:46:04,679 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,684 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/e4fcf628-90ae-4c79-8b96-3dd2a3c9adc6/data/default/foobar/2b2262bc8ae16e14a97d7b5693e80fbb/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,684 INFO [Time-limited test] regionserver.HRegion(960): Onlined 2b2262bc8ae16e14a97d7b5693e80fbb; next sequenceid=2 2018-01-13 17:46:04,684 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,685 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,685 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,685 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,685 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,708 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,791 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x00/column:0;0/1515883564708/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883564708/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883564708/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883564708/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883564708/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883564708/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883564708/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883564708/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883564708/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883564708/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:46:04,791 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x01/column:1;0/1515883564709/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883564709/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883564709/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883564709/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883564709/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883564709/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883564709/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883564709/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883564709/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883564709/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:46:04,791 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x02/column:2;0/1515883564709/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883564709/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883564709/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883564709/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883564709/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883564709/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883564709/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883564709/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883564709/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883564709/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:46:04,792 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x03/column:3;0/1515883564709/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883564709/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883564709/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883564709/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883564709/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883564709/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883564709/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883564709/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883564709/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883564709/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:46:04,792 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x04/column:4;0/1515883564710/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883564710/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883564710/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883564710/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883564710/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883564710/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883564710/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883564710/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883564710/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883564710/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:46:04,792 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x05/column:5;0/1515883564710/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883564710/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883564710/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883564710/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883564710/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883564710/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883564710/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883564710/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883564710/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883564710/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:46:04,792 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x06/column:6;0/1515883564710/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883564710/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883564710/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883564710/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883564710/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883564710/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883564710/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883564710/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883564710/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883564710/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:46:04,793 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x07/column:7;0/1515883564710/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883564710/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883564710/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883564710/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883564710/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883564710/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883564710/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883564710/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883564710/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883564710/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:46:04,793 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x08/column:8;0/1515883564710/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883564710/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883564710/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883564710/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883564710/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883564710/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883564710/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883564710/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883564710/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883564710/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:46:04,793 INFO [Time-limited test] regionserver.TestDefaultMemStore(170): [\x00\x00\x00\x09/column:9;0/1515883564710/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883564710/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883564710/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883564710/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883564710/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883564710/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883564710/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883564710/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883564710/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883564710/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:46:04,794 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x00/column:0;0/1515883564708/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883564708/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883564708/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883564708/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883564708/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883564708/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883564708/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883564708/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883564708/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883564708/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:46:04,794 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x01/column:1;0/1515883564709/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883564709/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883564709/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883564709/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883564709/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883564709/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883564709/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883564709/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883564709/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883564709/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:46:04,794 DEBUG [Time-limited test] regionserver.CompactingMemStore(205): FLUSHING TO DISK: region foobar,,1515883564659.2b2262bc8ae16e14a97d7b5693e80fbb.store: column 2018-01-13 17:46:04,794 DEBUG [Time-limited test] regionserver.CompactionPipeline(128): Swapping pipeline suffix; before=1, new segement=null 2018-01-13 17:46:04,794 INFO [Time-limited test] regionserver.TestDefaultMemStore(195): Snapshotted 2018-01-13 17:46:04,795 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x02/column:2;0/1515883564709/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883564709/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883564709/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883564709/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883564709/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883564709/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883564709/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883564709/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883564709/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883564709/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:46:04,795 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x03/column:3;0/1515883564709/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883564709/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883564709/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883564709/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883564709/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883564709/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883564709/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883564709/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883564709/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883564709/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:46:04,795 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x04/column:4;0/1515883564710/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883564710/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883564710/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883564710/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883564710/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883564710/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883564710/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883564710/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883564710/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883564710/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:46:04,795 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x05/column:5;0/1515883564710/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883564710/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883564710/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883564710/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883564710/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883564710/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883564710/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883564710/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883564710/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883564710/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:46:04,795 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x06/column:6;0/1515883564710/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883564710/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883564710/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883564710/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883564710/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883564710/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883564710/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883564710/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883564710/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883564710/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:46:04,796 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x07/column:7;0/1515883564710/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883564710/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883564710/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883564710/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883564710/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883564710/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883564710/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883564710/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883564710/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883564710/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:46:04,796 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x08/column:8;0/1515883564710/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883564710/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883564710/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883564710/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883564710/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883564710/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883564710/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883564710/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883564710/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883564710/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:46:04,796 INFO [Time-limited test] regionserver.TestDefaultMemStore(187): [\x00\x00\x00\x09/column:9;0/1515883564710/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883564710/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883564710/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883564710/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883564710/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883564710/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883564710/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883564710/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883564710/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883564710/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:46:04,796 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x00/column:0;0/1515883564708/Put/vlen=3/seqid=0/0;0, \x00\x00\x00\x00/column:0;1/1515883564708/Put/vlen=3/seqid=0/0;1, \x00\x00\x00\x00/column:0;2/1515883564708/Put/vlen=3/seqid=0/0;2, \x00\x00\x00\x00/column:0;3/1515883564708/Put/vlen=3/seqid=0/0;3, \x00\x00\x00\x00/column:0;4/1515883564708/Put/vlen=3/seqid=0/0;4, \x00\x00\x00\x00/column:0;5/1515883564708/Put/vlen=3/seqid=0/0;5, \x00\x00\x00\x00/column:0;6/1515883564708/Put/vlen=3/seqid=0/0;6, \x00\x00\x00\x00/column:0;7/1515883564708/Put/vlen=3/seqid=0/0;7, \x00\x00\x00\x00/column:0;8/1515883564708/Put/vlen=3/seqid=0/0;8, \x00\x00\x00\x00/column:0;9/1515883564708/Put/vlen=3/seqid=0/0;9] 2018-01-13 17:46:04,796 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x01/column:1;0/1515883564709/Put/vlen=3/seqid=0/1;0, \x00\x00\x00\x01/column:1;1/1515883564709/Put/vlen=3/seqid=0/1;1, \x00\x00\x00\x01/column:1;2/1515883564709/Put/vlen=3/seqid=0/1;2, \x00\x00\x00\x01/column:1;3/1515883564709/Put/vlen=3/seqid=0/1;3, \x00\x00\x00\x01/column:1;4/1515883564709/Put/vlen=3/seqid=0/1;4, \x00\x00\x00\x01/column:1;5/1515883564709/Put/vlen=3/seqid=0/1;5, \x00\x00\x00\x01/column:1;6/1515883564709/Put/vlen=3/seqid=0/1;6, \x00\x00\x00\x01/column:1;7/1515883564709/Put/vlen=3/seqid=0/1;7, \x00\x00\x00\x01/column:1;8/1515883564709/Put/vlen=3/seqid=0/1;8, \x00\x00\x00\x01/column:1;9/1515883564709/Put/vlen=3/seqid=0/1;9] 2018-01-13 17:46:04,797 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x02/column:2;0/1515883564709/Put/vlen=3/seqid=0/2;0, \x00\x00\x00\x02/column:2;1/1515883564709/Put/vlen=3/seqid=0/2;1, \x00\x00\x00\x02/column:2;2/1515883564709/Put/vlen=3/seqid=0/2;2, \x00\x00\x00\x02/column:2;3/1515883564709/Put/vlen=3/seqid=0/2;3, \x00\x00\x00\x02/column:2;4/1515883564709/Put/vlen=3/seqid=0/2;4, \x00\x00\x00\x02/column:2;5/1515883564709/Put/vlen=3/seqid=0/2;5, \x00\x00\x00\x02/column:2;6/1515883564709/Put/vlen=3/seqid=0/2;6, \x00\x00\x00\x02/column:2;7/1515883564709/Put/vlen=3/seqid=0/2;7, \x00\x00\x00\x02/column:2;8/1515883564709/Put/vlen=3/seqid=0/2;8, \x00\x00\x00\x02/column:2;9/1515883564709/Put/vlen=3/seqid=0/2;9] 2018-01-13 17:46:04,797 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x03/column:3;0/1515883564709/Put/vlen=3/seqid=0/3;0, \x00\x00\x00\x03/column:3;1/1515883564709/Put/vlen=3/seqid=0/3;1, \x00\x00\x00\x03/column:3;2/1515883564709/Put/vlen=3/seqid=0/3;2, \x00\x00\x00\x03/column:3;3/1515883564709/Put/vlen=3/seqid=0/3;3, \x00\x00\x00\x03/column:3;4/1515883564709/Put/vlen=3/seqid=0/3;4, \x00\x00\x00\x03/column:3;5/1515883564709/Put/vlen=3/seqid=0/3;5, \x00\x00\x00\x03/column:3;6/1515883564709/Put/vlen=3/seqid=0/3;6, \x00\x00\x00\x03/column:3;7/1515883564709/Put/vlen=3/seqid=0/3;7, \x00\x00\x00\x03/column:3;8/1515883564709/Put/vlen=3/seqid=0/3;8, \x00\x00\x00\x03/column:3;9/1515883564709/Put/vlen=3/seqid=0/3;9] 2018-01-13 17:46:04,797 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x04/column:4;0/1515883564710/Put/vlen=3/seqid=0/4;0, \x00\x00\x00\x04/column:4;1/1515883564710/Put/vlen=3/seqid=0/4;1, \x00\x00\x00\x04/column:4;2/1515883564710/Put/vlen=3/seqid=0/4;2, \x00\x00\x00\x04/column:4;3/1515883564710/Put/vlen=3/seqid=0/4;3, \x00\x00\x00\x04/column:4;4/1515883564710/Put/vlen=3/seqid=0/4;4, \x00\x00\x00\x04/column:4;5/1515883564710/Put/vlen=3/seqid=0/4;5, \x00\x00\x00\x04/column:4;6/1515883564710/Put/vlen=3/seqid=0/4;6, \x00\x00\x00\x04/column:4;7/1515883564710/Put/vlen=3/seqid=0/4;7, \x00\x00\x00\x04/column:4;8/1515883564710/Put/vlen=3/seqid=0/4;8, \x00\x00\x00\x04/column:4;9/1515883564710/Put/vlen=3/seqid=0/4;9] 2018-01-13 17:46:04,797 WARN [Time-limited test] regionserver.CompactingMemStore(201): Snapshot called again without clearing previous. Doing nothing. Another ongoing flush or did we fail last attempt? 2018-01-13 17:46:04,798 INFO [Time-limited test] regionserver.TestDefaultMemStore(222): Snapshotted, cleared it and then added values (which wont be seen) 2018-01-13 17:46:04,799 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x05/column:5;0/1515883564710/Put/vlen=3/seqid=0/5;0, \x00\x00\x00\x05/column:5;1/1515883564710/Put/vlen=3/seqid=0/5;1, \x00\x00\x00\x05/column:5;2/1515883564710/Put/vlen=3/seqid=0/5;2, \x00\x00\x00\x05/column:5;3/1515883564710/Put/vlen=3/seqid=0/5;3, \x00\x00\x00\x05/column:5;4/1515883564710/Put/vlen=3/seqid=0/5;4, \x00\x00\x00\x05/column:5;5/1515883564710/Put/vlen=3/seqid=0/5;5, \x00\x00\x00\x05/column:5;6/1515883564710/Put/vlen=3/seqid=0/5;6, \x00\x00\x00\x05/column:5;7/1515883564710/Put/vlen=3/seqid=0/5;7, \x00\x00\x00\x05/column:5;8/1515883564710/Put/vlen=3/seqid=0/5;8, \x00\x00\x00\x05/column:5;9/1515883564710/Put/vlen=3/seqid=0/5;9] 2018-01-13 17:46:04,799 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x06/column:6;0/1515883564710/Put/vlen=3/seqid=0/6;0, \x00\x00\x00\x06/column:6;1/1515883564710/Put/vlen=3/seqid=0/6;1, \x00\x00\x00\x06/column:6;2/1515883564710/Put/vlen=3/seqid=0/6;2, \x00\x00\x00\x06/column:6;3/1515883564710/Put/vlen=3/seqid=0/6;3, \x00\x00\x00\x06/column:6;4/1515883564710/Put/vlen=3/seqid=0/6;4, \x00\x00\x00\x06/column:6;5/1515883564710/Put/vlen=3/seqid=0/6;5, \x00\x00\x00\x06/column:6;6/1515883564710/Put/vlen=3/seqid=0/6;6, \x00\x00\x00\x06/column:6;7/1515883564710/Put/vlen=3/seqid=0/6;7, \x00\x00\x00\x06/column:6;8/1515883564710/Put/vlen=3/seqid=0/6;8, \x00\x00\x00\x06/column:6;9/1515883564710/Put/vlen=3/seqid=0/6;9] 2018-01-13 17:46:04,799 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x07/column:7;0/1515883564710/Put/vlen=3/seqid=0/7;0, \x00\x00\x00\x07/column:7;1/1515883564710/Put/vlen=3/seqid=0/7;1, \x00\x00\x00\x07/column:7;2/1515883564710/Put/vlen=3/seqid=0/7;2, \x00\x00\x00\x07/column:7;3/1515883564710/Put/vlen=3/seqid=0/7;3, \x00\x00\x00\x07/column:7;4/1515883564710/Put/vlen=3/seqid=0/7;4, \x00\x00\x00\x07/column:7;5/1515883564710/Put/vlen=3/seqid=0/7;5, \x00\x00\x00\x07/column:7;6/1515883564710/Put/vlen=3/seqid=0/7;6, \x00\x00\x00\x07/column:7;7/1515883564710/Put/vlen=3/seqid=0/7;7, \x00\x00\x00\x07/column:7;8/1515883564710/Put/vlen=3/seqid=0/7;8, \x00\x00\x00\x07/column:7;9/1515883564710/Put/vlen=3/seqid=0/7;9] 2018-01-13 17:46:04,799 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x08/column:8;0/1515883564710/Put/vlen=3/seqid=0/8;0, \x00\x00\x00\x08/column:8;1/1515883564710/Put/vlen=3/seqid=0/8;1, \x00\x00\x00\x08/column:8;2/1515883564710/Put/vlen=3/seqid=0/8;2, \x00\x00\x00\x08/column:8;3/1515883564710/Put/vlen=3/seqid=0/8;3, \x00\x00\x00\x08/column:8;4/1515883564710/Put/vlen=3/seqid=0/8;4, \x00\x00\x00\x08/column:8;5/1515883564710/Put/vlen=3/seqid=0/8;5, \x00\x00\x00\x08/column:8;6/1515883564710/Put/vlen=3/seqid=0/8;6, \x00\x00\x00\x08/column:8;7/1515883564710/Put/vlen=3/seqid=0/8;7, \x00\x00\x00\x08/column:8;8/1515883564710/Put/vlen=3/seqid=0/8;8, \x00\x00\x00\x08/column:8;9/1515883564710/Put/vlen=3/seqid=0/8;9] 2018-01-13 17:46:04,799 INFO [Time-limited test] regionserver.TestDefaultMemStore(211): [\x00\x00\x00\x09/column:9;0/1515883564710/Put/vlen=3/seqid=0/9;0, \x00\x00\x00\x09/column:9;1/1515883564710/Put/vlen=3/seqid=0/9;1, \x00\x00\x00\x09/column:9;2/1515883564710/Put/vlen=3/seqid=0/9;2, \x00\x00\x00\x09/column:9;3/1515883564710/Put/vlen=3/seqid=0/9;3, \x00\x00\x00\x09/column:9;4/1515883564710/Put/vlen=3/seqid=0/9;4, \x00\x00\x00\x09/column:9;5/1515883564710/Put/vlen=3/seqid=0/9;5, \x00\x00\x00\x09/column:9;6/1515883564710/Put/vlen=3/seqid=0/9;6, \x00\x00\x00\x09/column:9;7/1515883564710/Put/vlen=3/seqid=0/9;7, \x00\x00\x00\x09/column:9;8/1515883564710/Put/vlen=3/seqid=0/9;8, \x00\x00\x00\x09/column:9;9/1515883564710/Put/vlen=3/seqid=0/9;9] 2018-01-13 17:46:04,813 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testScanAcrossSnapshot[1] Thread=95 (was 117), OpenFileDescriptor=467 (was 510), MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=987 (was 1192) 2018-01-13 17:46:04,824 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreConcurrentControl[1] Thread=95, OpenFileDescriptor=467, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=988 2018-01-13 17:46:04,841 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,842 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,842 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49 2018-01-13 17:46:04,842 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49 2018-01-13 17:46:04,842 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,842 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49 2018-01-13 17:46:04,842 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,843 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-16906328, suffix=, logDir=file:/ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/WALs/hregion-16906328, archiveDir=file:/ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/oldWALs 2018-01-13 17:46:04,850 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/WALs/hregion-16906328/hregion-16906328.1515883564844 2018-01-13 17:46:04,850 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,850 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49 Table name == foobar 2018-01-13 17:46:04,860 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564842.54dd3692395c1ae1b74c5124c444cba3. 2018-01-13 17:46:04,861 DEBUG [StoreOpener-54dd3692395c1ae1b74c5124c444cba3-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,861 INFO [StoreOpener-54dd3692395c1ae1b74c5124c444cba3-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,861 INFO [StoreOpener-54dd3692395c1ae1b74c5124c444cba3-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,861 INFO [StoreOpener-54dd3692395c1ae1b74c5124c444cba3-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,861 INFO [StoreOpener-54dd3692395c1ae1b74c5124c444cba3-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,862 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564842.54dd3692395c1ae1b74c5124c444cba3. 2018-01-13 17:46:04,862 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/data/default/foobar/54dd3692395c1ae1b74c5124c444cba3 2018-01-13 17:46:04,862 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,870 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/data/default/foobar/54dd3692395c1ae1b74c5124c444cba3/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,870 INFO [Time-limited test] regionserver.HRegion(960): Onlined 54dd3692395c1ae1b74c5124c444cba3; next sequenceid=2 2018-01-13 17:46:04,870 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,870 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,871 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,871 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,871 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,888 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,900 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreConcurrentControl[1] Thread=97 (was 95) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/d684fd37-d3f0-44fb-9f6b-99d760500a49/WALs/hregion-16906328/hregion-16906328.1515883564844 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=472 (was 467) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=986 (was 988) 2018-01-13 17:46:04,914 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreDeletesVisibilityWithSameKey[1] Thread=97, OpenFileDescriptor=472, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=984 2018-01-13 17:46:04,932 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:04,932 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:04,932 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/0b302898-9300-4102-ad11-98893e6d7f00 2018-01-13 17:46:04,932 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/0b302898-9300-4102-ad11-98893e6d7f00 2018-01-13 17:46:04,932 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:04,932 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/0b302898-9300-4102-ad11-98893e6d7f00 2018-01-13 17:46:04,933 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:04,934 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-59324573, suffix=, logDir=file:/ram4G/0b302898-9300-4102-ad11-98893e6d7f00/WALs/hregion-59324573, archiveDir=file:/ram4G/0b302898-9300-4102-ad11-98893e6d7f00/oldWALs 2018-01-13 17:46:04,943 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/0b302898-9300-4102-ad11-98893e6d7f00/WALs/hregion-59324573/hregion-59324573.1515883564934 2018-01-13 17:46:04,943 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:04,943 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/0b302898-9300-4102-ad11-98893e6d7f00 Table name == foobar 2018-01-13 17:46:04,948 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883564932.3bc0f072175e1a533777cd1fbc5992c9. 2018-01-13 17:46:04,949 DEBUG [StoreOpener-3bc0f072175e1a533777cd1fbc5992c9-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,949 INFO [StoreOpener-3bc0f072175e1a533777cd1fbc5992c9-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,949 INFO [StoreOpener-3bc0f072175e1a533777cd1fbc5992c9-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,949 INFO [StoreOpener-3bc0f072175e1a533777cd1fbc5992c9-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,949 INFO [StoreOpener-3bc0f072175e1a533777cd1fbc5992c9-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,950 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883564932.3bc0f072175e1a533777cd1fbc5992c9. 2018-01-13 17:46:04,950 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/0b302898-9300-4102-ad11-98893e6d7f00/data/default/foobar/3bc0f072175e1a533777cd1fbc5992c9 2018-01-13 17:46:04,950 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:04,955 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/0b302898-9300-4102-ad11-98893e6d7f00/data/default/foobar/3bc0f072175e1a533777cd1fbc5992c9/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:04,955 INFO [Time-limited test] regionserver.HRegion(960): Onlined 3bc0f072175e1a533777cd1fbc5992c9; next sequenceid=2 2018-01-13 17:46:04,955 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:04,956 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,956 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:04,956 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:04,956 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:04,977 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:04,990 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMemstoreDeletesVisibilityWithSameKey[1] Thread=99 (was 97) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/0b302898-9300-4102-ad11-98893e6d7f00/WALs/hregion-59324573/hregion-59324573.1515883564934 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=477 (was 472) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=984 (was 984) 2018-01-13 17:46:05,005 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testMultipleVersionsSimple[1] Thread=99, OpenFileDescriptor=477, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=984 2018-01-13 17:46:05,019 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:05,019 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:05,019 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad 2018-01-13 17:46:05,019 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad 2018-01-13 17:46:05,019 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:05,019 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad 2018-01-13 17:46:05,019 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:05,020 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-11048938, suffix=, logDir=file:/ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/WALs/hregion-11048938, archiveDir=file:/ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/oldWALs 2018-01-13 17:46:05,027 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/WALs/hregion-11048938/hregion-11048938.1515883565020 2018-01-13 17:46:05,027 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:05,027 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad Table name == foobar 2018-01-13 17:46:05,036 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883565019.d14b8d0b1c79c93352edc80bafa1b717. 2018-01-13 17:46:05,037 DEBUG [StoreOpener-d14b8d0b1c79c93352edc80bafa1b717-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,038 INFO [StoreOpener-d14b8d0b1c79c93352edc80bafa1b717-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,038 INFO [StoreOpener-d14b8d0b1c79c93352edc80bafa1b717-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,038 INFO [StoreOpener-d14b8d0b1c79c93352edc80bafa1b717-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,038 INFO [StoreOpener-d14b8d0b1c79c93352edc80bafa1b717-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,039 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883565019.d14b8d0b1c79c93352edc80bafa1b717. 2018-01-13 17:46:05,039 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/data/default/foobar/d14b8d0b1c79c93352edc80bafa1b717 2018-01-13 17:46:05,039 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:05,046 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/data/default/foobar/d14b8d0b1c79c93352edc80bafa1b717/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:05,047 INFO [Time-limited test] regionserver.HRegion(960): Onlined d14b8d0b1c79c93352edc80bafa1b717; next sequenceid=2 2018-01-13 17:46:05,047 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,047 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,047 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,047 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,048 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,067 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,097 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testMultipleVersionsSimple[1] Thread=101 (was 99) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/cf5e57df-74a3-4ea5-b98e-6afa06e5a9ad/WALs/hregion-11048938/hregion-11048938.1515883565020 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=482 (was 477) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=978 (was 984) 2018-01-13 17:46:05,109 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testReadOwnWritesUnderConcurrency[1] Thread=101, OpenFileDescriptor=482, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=978 2018-01-13 17:46:05,134 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:05,134 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:05,134 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/8507750e-825f-4120-bfac-d9c223114bf5 2018-01-13 17:46:05,134 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/8507750e-825f-4120-bfac-d9c223114bf5 2018-01-13 17:46:05,135 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:05,135 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/8507750e-825f-4120-bfac-d9c223114bf5 2018-01-13 17:46:05,135 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:05,136 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-81264118, suffix=, logDir=file:/ram4G/8507750e-825f-4120-bfac-d9c223114bf5/WALs/hregion-81264118, archiveDir=file:/ram4G/8507750e-825f-4120-bfac-d9c223114bf5/oldWALs 2018-01-13 17:46:05,146 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/8507750e-825f-4120-bfac-d9c223114bf5/WALs/hregion-81264118/hregion-81264118.1515883565137 2018-01-13 17:46:05,146 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:05,146 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/8507750e-825f-4120-bfac-d9c223114bf5 Table name == foobar 2018-01-13 17:46:05,152 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883565135.cc8983ee8c64db22c3237190a9cc2e78. 2018-01-13 17:46:05,154 DEBUG [StoreOpener-cc8983ee8c64db22c3237190a9cc2e78-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,154 INFO [StoreOpener-cc8983ee8c64db22c3237190a9cc2e78-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,154 INFO [StoreOpener-cc8983ee8c64db22c3237190a9cc2e78-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,154 INFO [StoreOpener-cc8983ee8c64db22c3237190a9cc2e78-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,155 INFO [StoreOpener-cc8983ee8c64db22c3237190a9cc2e78-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,155 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883565135.cc8983ee8c64db22c3237190a9cc2e78. 2018-01-13 17:46:05,155 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/8507750e-825f-4120-bfac-d9c223114bf5/data/default/foobar/cc8983ee8c64db22c3237190a9cc2e78 2018-01-13 17:46:05,156 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:05,161 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/8507750e-825f-4120-bfac-d9c223114bf5/data/default/foobar/cc8983ee8c64db22c3237190a9cc2e78/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:05,161 INFO [Time-limited test] regionserver.HRegion(960): Onlined cc8983ee8c64db22c3237190a9cc2e78; next sequenceid=2 2018-01-13 17:46:05,161 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,161 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,161 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,162 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,162 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,181 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,322 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testReadOwnWritesUnderConcurrency[1] Thread=103 (was 101) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/8507750e-825f-4120-bfac-d9c223114bf5/WALs/hregion-81264118/hregion-81264118.1515883565137 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=487 (was 482) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=967 (was 978) 2018-01-13 17:46:05,336 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameCell[1] Thread=103, OpenFileDescriptor=489, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=965 2018-01-13 17:46:05,355 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:05,356 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:05,356 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3 2018-01-13 17:46:05,356 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3 2018-01-13 17:46:05,356 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:05,356 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3 2018-01-13 17:46:05,358 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:05,359 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-22536311, suffix=, logDir=file:/ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/WALs/hregion-22536311, archiveDir=file:/ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/oldWALs 2018-01-13 17:46:05,376 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/WALs/hregion-22536311/hregion-22536311.1515883565359 2018-01-13 17:46:05,376 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:05,376 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3 Table name == foobar 2018-01-13 17:46:05,384 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883565356.884787a5b88ff01d58395cf50f533408. 2018-01-13 17:46:05,385 DEBUG [StoreOpener-884787a5b88ff01d58395cf50f533408-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,385 INFO [StoreOpener-884787a5b88ff01d58395cf50f533408-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,385 INFO [StoreOpener-884787a5b88ff01d58395cf50f533408-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,385 INFO [StoreOpener-884787a5b88ff01d58395cf50f533408-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,385 INFO [StoreOpener-884787a5b88ff01d58395cf50f533408-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,386 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883565356.884787a5b88ff01d58395cf50f533408. 2018-01-13 17:46:05,386 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/data/default/foobar/884787a5b88ff01d58395cf50f533408 2018-01-13 17:46:05,386 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:05,390 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/data/default/foobar/884787a5b88ff01d58395cf50f533408/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:05,390 INFO [Time-limited test] regionserver.HRegion(960): Onlined 884787a5b88ff01d58395cf50f533408; next sequenceid=2 2018-01-13 17:46:05,390 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,390 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,391 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,391 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,391 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,408 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,422 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameCell[1] Thread=105 (was 103) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/9a2b315c-e688-43df-b7e4-0d5ebf9ec4b3/WALs/hregion-22536311/hregion-22536311.1515883565359 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=492 (was 489) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=927 (was 965) 2018-01-13 17:46:05,439 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameKey[1] Thread=105, OpenFileDescriptor=492, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=199, AvailableMemoryMB=923 2018-01-13 17:46:05,455 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:05,455 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:05,455 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319 2018-01-13 17:46:05,455 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319 2018-01-13 17:46:05,456 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:05,456 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319 2018-01-13 17:46:05,456 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:05,457 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-05681879, suffix=, logDir=file:/ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/WALs/hregion-05681879, archiveDir=file:/ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/oldWALs 2018-01-13 17:46:05,471 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/WALs/hregion-05681879/hregion-05681879.1515883565457 2018-01-13 17:46:05,471 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:05,471 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319 Table name == foobar 2018-01-13 17:46:05,486 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883565456.f11f362f86e7771482f1bf05911867af. 2018-01-13 17:46:05,489 DEBUG [StoreOpener-f11f362f86e7771482f1bf05911867af-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,490 INFO [StoreOpener-f11f362f86e7771482f1bf05911867af-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,490 INFO [StoreOpener-f11f362f86e7771482f1bf05911867af-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,491 INFO [StoreOpener-f11f362f86e7771482f1bf05911867af-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,492 INFO [StoreOpener-f11f362f86e7771482f1bf05911867af-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,495 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883565456.f11f362f86e7771482f1bf05911867af. 2018-01-13 17:46:05,495 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/data/default/foobar/f11f362f86e7771482f1bf05911867af 2018-01-13 17:46:05,496 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:05,511 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/data/default/foobar/f11f362f86e7771482f1bf05911867af/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:05,512 INFO [Time-limited test] regionserver.HRegion(960): Onlined f11f362f86e7771482f1bf05911867af; next sequenceid=2 2018-01-13 17:46:05,512 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,512 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,512 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,512 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,512 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,529 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,548 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testPutSameKey[1] Thread=108 (was 105) Potentially hanging thread: Time-limited test sun.misc.Unsafe.unpark(Native Method) java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141) java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:372) java.util.concurrent.FutureTask.set(FutureTask.java:233) java.util.concurrent.FutureTask.run(FutureTask.java:274) java.lang.Thread.run(Thread.java:748) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/24d83f4d-3410-4fea-bdf1-a38a9f845319/WALs/hregion-05681879/hregion-05681879.1515883565457 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=497 (was 492) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=199 (was 199), AvailableMemoryMB=907 (was 923) 2018-01-13 17:46:05,568 INFO [main] hbase.ResourceChecker(148): before: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteVersion[1] Thread=107, OpenFileDescriptor=497, MaxFileDescriptor=1048576, SystemLoadAverage=1014, ProcessCount=201, AvailableMemoryMB=903 2018-01-13 17:46:05,586 DEBUG [Time-limited test] hbase.HBaseTestingUtility(315): Config property hbase.master.info.port changed to -1 2018-01-13 17:46:05,586 DEBUG [Time-limited test] hbase.HBaseTestingUtility(320): Config property hbase.regionserver.port changed to -1 2018-01-13 17:46:05,586 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.log.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-log-dir so I do NOT create it in /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495 2018-01-13 17:46:05,586 INFO [Time-limited test] hbase.HBaseTestingUtility(439): System.getProperty("hadoop.tmp.dir") already set to: /ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir so I do NOT create it in /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495 2018-01-13 17:46:05,586 WARN [Time-limited test] hbase.HBaseTestingUtility(443): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jmspaggi while System=/ram4G/6dfff2dd-53a2-4c4d-9896-b1b750197f74/hadoop-tmp-dir Erasing configuration value by system value. 2018-01-13 17:46:05,587 DEBUG [Time-limited test] hbase.HBaseTestingUtility(348): Setting hbase.rootdir to /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495 2018-01-13 17:46:05,587 INFO [Time-limited test] wal.WALFactory(143): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-01-13 17:46:05,589 INFO [Time-limited test] wal.AbstractFSWAL(425): WAL configuration: blocksize=64 MB, rollsize=32 MB, prefix=hregion-47057142, suffix=, logDir=file:/ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/WALs/hregion-47057142, archiveDir=file:/ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/oldWALs 2018-01-13 17:46:05,606 INFO [Time-limited test] wal.AbstractFSWAL(708): New WAL /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/WALs/hregion-47057142/hregion-47057142.1515883565589 2018-01-13 17:46:05,606 DEBUG [Time-limited test] wal.AbstractFSWAL(772): Create new AsyncFSWAL writer with pipeline: [] 2018-01-13 17:46:05,607 INFO [Time-limited test] regionserver.HRegion(6772): creating HRegion foobar HTD == 'foobar', {NAME => 'column', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495 Table name == foobar 2018-01-13 17:46:05,612 DEBUG [Time-limited test] regionserver.HRegion(807): Instantiated foobar,,1515883565587.d83f2607f2590bd21dbddcc07120d3a1. 2018-01-13 17:46:05,613 DEBUG [StoreOpener-d83f2607f2590bd21dbddcc07120d3a1-1] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5497) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1002) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:999) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,614 INFO [StoreOpener-d83f2607f2590bd21dbddcc07120d3a1-1] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,614 INFO [StoreOpener-d83f2607f2590bd21dbddcc07120d3a1-1] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,614 INFO [StoreOpener-d83f2607f2590bd21dbddcc07120d3a1-1] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,614 INFO [StoreOpener-d83f2607f2590bd21dbddcc07120d3a1-1] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,614 INFO [Time-limited test] regionserver.HRegion(1033): Setting FlushNonSloppyStoresFirstPolicy for the region=foobar,,1515883565587.d83f2607f2590bd21dbddcc07120d3a1. 2018-01-13 17:46:05,615 DEBUG [Time-limited test] regionserver.HRegion(4350): Found 0 recovered edits file(s) under /ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/data/default/foobar/d83f2607f2590bd21dbddcc07120d3a1 2018-01-13 17:46:05,615 DEBUG [Time-limited test] regionserver.FlushLargeStoresPolicy(60): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table foobar descriptor;using region.getMemStoreFlushSize/# of families (128,0M)) instead. 2018-01-13 17:46:05,621 DEBUG [Time-limited test] wal.WALSplitter(674): Wrote file=/ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/data/default/foobar/d83f2607f2590bd21dbddcc07120d3a1/recovered.edits/2.seqid, newSeqId=2, maxSeqId=0 2018-01-13 17:46:05,622 INFO [Time-limited test] regionserver.HRegion(960): Onlined d83f2607f2590bd21dbddcc07120d3a1; next sequenceid=2 2018-01-13 17:46:05,622 DEBUG [Time-limited test] util.CommonFSUtils(538): FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:528) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:518) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:193) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:252) at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:111) at org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore.setUp(TestCompactingToCellFlatMapMemStore.java:76) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-01-13 17:46:05,622 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 13421772 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,622 INFO [Time-limited test] regionserver.HStore(293): Memstore class name is org.apache.hadoop.hbase.regionserver.CompactingMemStore 2018-01-13 17:46:05,622 INFO [Time-limited test] hfile.CacheConfig(239): Created cacheConfig for column: blockCache=LruBlockCache{blockCount=0, currentSize=765640, freeSize=1043196664, maxSize=1043962304, heapSize=765640, minSize=991764160, minFactor=0.95, multiSize=495882080, multiFactor=0.5, singleSize=247941040, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-01-13 17:46:05,623 INFO [Time-limited test] compactions.CompactionConfiguration(146): size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1,200000; off-peak ratio 5,000000; throttle point 2684354560; major period 604800000, major jitter 0,500000, min locality to compact 0,000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-01-13 17:46:05,652 INFO [Time-limited test] regionserver.CompactingMemStore(147): Setting in-memory flush size threshold to 2684354 and immutable segments index to be of type CHUNK_MAP 2018-01-13 17:46:05,672 INFO [main] hbase.ResourceChecker(172): after: regionserver.TestCompactingToCellFlatMapMemStore#testRetainsDeleteVersion[1] Thread=109 (was 107) Potentially hanging thread: AsyncFSOutputFlusher-file:/ram4G/cd53fe9a-6be4-4413-ad6e-ec24d7aa1495/WALs/hregion-47057142/hregion-47057142.1515883565589 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748) - Thread LEAK? -, OpenFileDescriptor=502 (was 497) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1048576 (was 1048576), SystemLoadAverage=1014 (was 1014), ProcessCount=201 (was 201), AvailableMemoryMB=895 (was 903)