./node-1/hbase-root-master-node-1.cluster.log:1773:2016-11-08 03:50:20,924 INFO [AM.ZK.Worker-pool2-t126] master.RegionStates: Transition null to {393d2bfd8b1c52ce08540306659624f2 state=MERGING_NEW, ts=1478577020924, server=node-5.cluster,16020,1478576985475} ./node-1/hbase-root-master-node-1.cluster.log:1778:2016-11-08 03:50:21,144 INFO [AM.ZK.Worker-pool2-t127] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=MERGING_NEW, ts=1478577021143, server=node-5.cluster,16020,1478576985475} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577021144, server=node-5.cluster,16020,1478576985475} ./node-1/hbase-root-master-node-1.cluster.log:1779:2016-11-08 03:50:21,145 INFO [AM.ZK.Worker-pool2-t127] master.AssignmentManager: Handled MERGED event; merged=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., region_a=IntegrationTestBigLinkedList,,1478574759285.88ac56ffbdd3169e6bfc33bec3aa83f6., region_b=IntegrationTestBigLinkedList, \x00\x00\x00\x00\x00\x00\x00,1478575328828.1789f9fdd7130abba2b52392b5f30854., on node-5.cluster,16020,1478576985475 ./node-1/hbase-root-master-node-1.cluster.log:1797:2016-11-08 03:51:53,193 INFO [node-1.cluster,16000,1478575412231-org.apache.hadoop.hbase.master.BulkReOpen-3] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577021144, server=node-5.cluster,16020,1478576985475} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577113193, server=node-5.cluster,16020,1478576985475} ./node-1/hbase-root-master-node-1.cluster.log:1841:2016-11-08 03:52:16,133 INFO [ProcedureExecutor-12] master.RegionStates: Transitioning {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577113193, server=node-5.cluster,16020,1478576985475} will be handled by ServerCrashProcedure for node-5.cluster,16020,1478576985475 ./node-1/hbase-root-master-node-1.cluster.log:1844:2016-11-08 03:52:16,134 INFO [ProcedureExecutor-12] procedure.ServerCrashProcedure: Reassigning region {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577113193, server=node-5.cluster,16020,1478576985475} and clearing zknode if exists ./node-1/hbase-root-master-node-1.cluster.log:1845:2016-11-08 03:52:16,140 INFO [ProcedureExecutor-12] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577113193, server=node-5.cluster,16020,1478576985475} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577136140, server=node-5.cluster,16020,1478576985475} ./node-1/hbase-root-master-node-1.cluster.log:1851:2016-11-08 03:52:16,200 INFO [node-1.cluster,16000,1478575412231-GeneralBulkAssigner-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577136195, server=node-5.cluster,16020,1478576985475} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577136200, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1853:2016-11-08 03:52:16,215 INFO [AM.ZK.Worker-pool2-t146] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577136200, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577136215, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1860:2016-11-08 03:52:22,815 INFO [AM.ZK.Worker-pool2-t155] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577136215, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577142815, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1861:2016-11-08 03:52:22,822 INFO [AM.ZK.Worker-pool2-t155] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-5.cluster,16020,1478576985475 ./node-1/hbase-root-master-node-1.cluster.log:1880:2016-11-08 03:53:22,476 INFO [node-1.cluster,16000,1478575412231-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577142822, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577202476, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1896:2016-11-08 03:53:29,537 INFO [AM.ZK.Worker-pool2-t175] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577202476, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577209537, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1897:2016-11-08 03:53:29,538 INFO [AM.ZK.Worker-pool2-t175] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:1898:2016-11-08 03:53:29,538 INFO [AM.ZK.Worker-pool2-t175] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577209537, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577209538, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1899:2016-11-08 03:53:29,540 INFO [AM.ZK.Worker-pool2-t175] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-1/hbase-root-master-node-1.cluster.log:1900:2016-11-08 03:53:29,540 INFO [AM.ZK.Worker-pool2-t175] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577209538, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577209540, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1901:2016-11-08 03:53:29,578 INFO [AM.ZK.Worker-pool2-t177] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577209540, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577209578, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:1902:2016-11-08 03:53:30,215 INFO [AM.ZK.Worker-pool2-t178] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577209578, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577210215, server=node-4.cluster,16020,1478575564466} ./node-1/hbase-root-master-node-1.cluster.log:2187:2016-11-08 04:17:22,173 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578639546, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578642172, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2189:2016-11-08 04:17:23,050 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578642172, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578643050, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2190:2016-11-08 04:17:23,050 INFO [AM.ZK.Worker-pool2-t3] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:2191:2016-11-08 04:17:23,051 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578643050, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578643051, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2192:2016-11-08 04:17:23,067 INFO [AM.ZK.Worker-pool2-t3] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478578389506 ./node-1/hbase-root-master-node-1.cluster.log:2193:2016-11-08 04:17:23,067 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578643051, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578643067, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2194:2016-11-08 04:17:23,088 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578643067, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578643088, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2195:2016-11-08 04:17:23,889 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578643089, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578643889, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2224:2016-11-08 04:18:51,601 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578643911, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578731601, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2233:2016-11-08 04:18:56,693 INFO [AM.ZK.Worker-pool2-t28] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578731601, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578736693, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2234:2016-11-08 04:18:56,693 INFO [AM.ZK.Worker-pool2-t28] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:2235:2016-11-08 04:18:56,693 INFO [AM.ZK.Worker-pool2-t28] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578736693, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578736693, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2236:2016-11-08 04:18:56,696 INFO [AM.ZK.Worker-pool2-t28] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478578389506 ./node-1/hbase-root-master-node-1.cluster.log:2237:2016-11-08 04:18:56,696 INFO [AM.ZK.Worker-pool2-t28] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578736693, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578736696, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2238:2016-11-08 04:18:56,732 INFO [AM.ZK.Worker-pool2-t30] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578736696, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578736731, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2239:2016-11-08 04:18:57,187 INFO [AM.ZK.Worker-pool2-t31] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578736731, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578737187, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2273:2016-11-08 04:20:21,518 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578737192, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578821518, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2274:2016-11-08 04:20:22,151 INFO [AM.ZK.Worker-pool2-t42] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578821518, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578822151, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2275:2016-11-08 04:20:22,151 INFO [AM.ZK.Worker-pool2-t42] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:2276:2016-11-08 04:20:22,151 INFO [AM.ZK.Worker-pool2-t42] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578822151, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578822151, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2277:2016-11-08 04:20:22,156 INFO [AM.ZK.Worker-pool2-t42] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478578389506 ./node-1/hbase-root-master-node-1.cluster.log:2278:2016-11-08 04:20:22,156 INFO [AM.ZK.Worker-pool2-t42] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578822151, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578822156, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2279:2016-11-08 04:20:22,176 INFO [AM.ZK.Worker-pool2-t44] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578822156, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578822176, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2280:2016-11-08 04:20:22,437 INFO [AM.ZK.Worker-pool2-t45] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578822176, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578822437, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2381:2016-11-08 04:23:21,187 INFO [AM.ZK.Worker-pool2-t82] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578822440, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=SPLITTING, ts=1478579001187, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2382:2016-11-08 04:23:27,057 INFO [AM.ZK.Worker-pool2-t84] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=SPLITTING, ts=1478579007057, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2383:2016-11-08 04:23:27,058 INFO [AM.ZK.Worker-pool2-t84] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-3.cluster,16020,1478578389506 ./node-1/hbase-root-master-node-1.cluster.log:2386:2016-11-08 04:23:27,059 INFO [AM.ZK.Worker-pool2-t84] master.AssignmentManager: Handled SPLIT event; parent=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., daughter a=IntegrationTestBigLinkedList,,1478579001155.d55ef81c2f8299abbddfce0445067830., daughter b=IntegrationTestBigLinkedList,/\xFB\x14,1478579001155.08629d59564726da2497f70451aafcdb., on node-3.cluster,16020,1478578389506 ./node-1/hbase-root-master-node-1.cluster.log:2700:2016-11-08 04:29:38,518 INFO [B.defaultRpcServer.handler=21,queue=0,port=16000] master.HMaster: Client=root//192.168.124.2 move hri=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., src=node-3.cluster,16020,1478578389506, dest=node-5.cluster,16020,1478579265627, running balancer ./node-1/hbase-root-master-node-1.cluster.log:2701:2016-11-08 04:29:38,518 INFO [B.defaultRpcServer.handler=21,queue=0,port=16000] master.AssignmentManager: Ignored moving region not assigned: {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'}, {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2764:2016-11-08 04:30:01,317 ERROR [MASTER_TABLE_OPERATIONS-node-1:16000-0] snapshot.MasterSnapshotVerifier: No snapshot region directory found for region:{ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:2845:2016-11-08 04:32:59,959 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:2874:2016-11-08 04:34:31,219 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:2898:2016-11-08 04:36:01,147 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:2923:2016-11-08 04:37:07,716 INFO [B.defaultRpcServer.handler=16,queue=1,port=16000] master.HMaster: Client=root//192.168.124.2 move hri=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., src=node-3.cluster,16020,1478578389506, dest=node-4.cluster,16020,1478578838719, running balancer ./node-1/hbase-root-master-node-1.cluster.log:2924:2016-11-08 04:37:07,716 INFO [B.defaultRpcServer.handler=16,queue=1,port=16000] master.AssignmentManager: Ignored moving region not assigned: {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'}, {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506} ./node-1/hbase-root-master-node-1.cluster.log:2953:2016-11-08 04:37:30,819 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:2977:2016-11-08 04:38:59,819 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3034:2016-11-08 04:40:29,865 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3052:2016-11-08 04:40:51,695 INFO [B.defaultRpcServer.handler=6,queue=0,port=16000] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3059:2016-11-08 04:41:59,755 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3117:2016-11-08 04:43:31,829 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-1] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3441:2016-11-08 04:46:29,823 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-0] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:3560:2016-11-08 04:49:30,257 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-1] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:4129:2016-11-08 04:56:07,927 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-1] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:4208:2016-11-08 04:57:38,131 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-1] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:4257:2016-11-08 04:59:07,880 INFO [node-1.cluster,16000,1478577286433-org.apache.hadoop.hbase.master.BulkReOpen-1] master.AssignmentManager: Attempting to unassign {393d2bfd8b1c52ce08540306659624f2 state=SPLIT, ts=1478579007057, server=node-3.cluster,16020,1478578389506}, ignored ./node-1/hbase-root-master-node-1.cluster.log:4964:2016-11-08 05:07:34,474 INFO [ProcedureExecutor-15] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581486984, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581654474, server=node-3.cluster,16020,1478580753290} ./node-1/hbase-root-master-node-1.cluster.log:4971:2016-11-08 05:07:34,481 INFO [node-1.cluster,16000,1478581182928-GeneralBulkAssigner-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581654476, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581654481, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:4974:2016-11-08 05:07:34,539 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581654481, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581654539, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:4984:2016-11-08 05:07:34,872 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581654539, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581654872, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:4987:2016-11-08 05:07:34,874 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-3.cluster,16020,1478580753290 ./node-1/hbase-root-master-node-1.cluster.log:5003:2016-11-08 05:08:08,297 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581654874, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581688297, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5005:2016-11-08 05:08:08,337 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581688297, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581688337, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5006:2016-11-08 05:08:08,337 INFO [AM.ZK.Worker-pool2-t4] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5007:2016-11-08 05:08:08,337 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581688337, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581688337, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5008:2016-11-08 05:08:08,339 INFO [AM.ZK.Worker-pool2-t4] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478581638184 ./node-1/hbase-root-master-node-1.cluster.log:5009:2016-11-08 05:08:08,339 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581688337, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581688339, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5015:2016-11-08 05:08:08,345 INFO [AM.ZK.Worker-pool2-t8] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581688339, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581688345, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5017:2016-11-08 05:08:08,397 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581688345, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581688397, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5027:2016-11-08 05:08:17,345 INFO [B.defaultRpcServer.handler=18,queue=0,port=16000] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581688399, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581697345, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5028:2016-11-08 05:08:17,360 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581697345, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581697360, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5029:2016-11-08 05:08:17,361 INFO [AM.ZK.Worker-pool2-t6] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5030:2016-11-08 05:08:17,361 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581697360, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581697361, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5031:2016-11-08 05:08:17,362 INFO [AM.ZK.Worker-pool2-t6] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-2.cluster,16020,1478581647752 ./node-1/hbase-root-master-node-1.cluster.log:5032:2016-11-08 05:08:17,362 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581697361, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581697362, server=node-2.cluster,16020,1478581647752} ./node-1/hbase-root-master-node-1.cluster.log:5033:2016-11-08 05:08:17,368 INFO [AM.ZK.Worker-pool2-t8] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581697362, server=node-2.cluster,16020,1478581647752} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581697368, server=node-2.cluster,16020,1478581647752} ./node-1/hbase-root-master-node-1.cluster.log:5034:2016-11-08 05:08:17,410 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581697368, server=node-2.cluster,16020,1478581647752} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581697410, server=node-2.cluster,16020,1478581647752} ./node-1/hbase-root-master-node-1.cluster.log:5035:2016-11-08 05:08:17,411 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-4.cluster,16020,1478581638184 ./node-1/hbase-root-master-node-1.cluster.log:5163:2016-11-08 05:12:11,895 INFO [ProcedureExecutor-9] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581697411, server=node-2.cluster,16020,1478581647752} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581931895, server=node-2.cluster,16020,1478581647752} ./node-1/hbase-root-master-node-1.cluster.log:5168:2016-11-08 05:12:11,903 INFO [node-1.cluster,16000,1478581182928-GeneralBulkAssigner-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581931897, server=node-2.cluster,16020,1478581647752} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581931903, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5169:2016-11-08 05:12:11,914 INFO [AM.ZK.Worker-pool2-t32] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581931903, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581931914, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5171:2016-11-08 05:12:12,104 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581931914, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581932104, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5172:2016-11-08 05:12:12,106 INFO [AM.ZK.Worker-pool2-t36] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-2.cluster,16020,1478581647752 ./node-1/hbase-root-master-node-1.cluster.log:5184:2016-11-08 05:12:38,132 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-0] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581932106, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581958132, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5186:2016-11-08 05:12:38,153 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581958132, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581958153, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5187:2016-11-08 05:12:38,153 INFO [AM.ZK.Worker-pool2-t41] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5188:2016-11-08 05:12:38,153 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581958153, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581958153, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5189:2016-11-08 05:12:38,154 INFO [AM.ZK.Worker-pool2-t41] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478581638184 ./node-1/hbase-root-master-node-1.cluster.log:5190:2016-11-08 05:12:38,154 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581958153, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581958154, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5195:2016-11-08 05:12:38,162 INFO [AM.ZK.Worker-pool2-t43] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581958154, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581958162, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5198:2016-11-08 05:12:38,200 INFO [AM.ZK.Worker-pool2-t47] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581958163, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581958200, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5260:2016-11-08 05:14:43,797 INFO [ProcedureExecutor-5] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581958201, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582083797, server=node-4.cluster,16020,1478581638184} ./node-1/hbase-root-master-node-1.cluster.log:5265:2016-11-08 05:14:43,803 INFO [ProcedureExecutor-5] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582083798, server=node-4.cluster,16020,1478581638184} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582083803, server=node-2.cluster,16020,1478581987881} ./node-1/hbase-root-master-node-1.cluster.log:5270:2016-11-08 05:14:43,842 INFO [AM.ZK.Worker-pool2-t63] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582083803, server=node-2.cluster,16020,1478581987881} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582083842, server=node-2.cluster,16020,1478581987881} ./node-1/hbase-root-master-node-1.cluster.log:5347:2016-11-08 05:14:48,258 INFO [AM.ZK.Worker-pool2-t69] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582083842, server=node-2.cluster,16020,1478581987881} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582088258, server=node-2.cluster,16020,1478581987881} ./node-1/hbase-root-master-node-1.cluster.log:5350:2016-11-08 05:14:48,260 INFO [AM.ZK.Worker-pool2-t69] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-4.cluster,16020,1478581638184 ./node-1/hbase-root-master-node-1.cluster.log:5598:2016-11-08 05:15:01,097 INFO [ProcedureExecutor-6] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582088260, server=node-2.cluster,16020,1478581987881} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582101097, server=node-2.cluster,16020,1478581987881} ./node-1/hbase-root-master-node-1.cluster.log:5607:2016-11-08 05:15:01,144 INFO [node-1.cluster,16000,1478581182928-GeneralBulkAssigner-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582101139, server=node-2.cluster,16020,1478581987881} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582101144, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5609:2016-11-08 05:15:01,152 INFO [AM.ZK.Worker-pool2-t71] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582101144, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582101152, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5613:2016-11-08 05:15:01,250 INFO [AM.ZK.Worker-pool2-t59] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582101152, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582101250, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5614:2016-11-08 05:15:01,252 INFO [AM.ZK.Worker-pool2-t58] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-2.cluster,16020,1478581987881 ./node-1/hbase-root-master-node-1.cluster.log:5641:2016-11-08 05:15:38,121 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582101251, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582138121, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5643:2016-11-08 05:15:38,147 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582138121, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582138147, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5644:2016-11-08 05:15:38,147 INFO [AM.ZK.Worker-pool2-t54] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5645:2016-11-08 05:15:38,147 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582138147, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582138147, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5646:2016-11-08 05:15:38,148 INFO [AM.ZK.Worker-pool2-t54] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478582087459 ./node-1/hbase-root-master-node-1.cluster.log:5647:2016-11-08 05:15:38,149 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582138147, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582138149, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5648:2016-11-08 05:15:38,155 INFO [AM.ZK.Worker-pool2-t56] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582138149, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582138155, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5655:2016-11-08 05:15:38,221 INFO [AM.ZK.Worker-pool2-t57] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582138155, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582138221, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5697:2016-11-08 05:17:08,146 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582138223, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582228146, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5701:2016-11-08 05:17:08,170 INFO [AM.ZK.Worker-pool2-t82] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582228146, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582228170, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5702:2016-11-08 05:17:08,170 INFO [AM.ZK.Worker-pool2-t82] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5703:2016-11-08 05:17:08,170 INFO [AM.ZK.Worker-pool2-t82] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582228170, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582228170, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5704:2016-11-08 05:17:08,171 INFO [AM.ZK.Worker-pool2-t82] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478582087459 ./node-1/hbase-root-master-node-1.cluster.log:5705:2016-11-08 05:17:08,171 INFO [AM.ZK.Worker-pool2-t82] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582228170, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582228171, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5706:2016-11-08 05:17:08,177 INFO [AM.ZK.Worker-pool2-t84] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582228171, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582228177, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5707:2016-11-08 05:17:08,228 INFO [AM.ZK.Worker-pool2-t85] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582228177, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582228228, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5748:2016-11-08 05:18:38,131 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582228229, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582318131, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5771:2016-11-08 05:18:38,376 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582318131, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582318376, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5772:2016-11-08 05:18:38,376 INFO [AM.ZK.Worker-pool2-t93] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5773:2016-11-08 05:18:38,376 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582318376, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582318376, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5774:2016-11-08 05:18:38,377 INFO [AM.ZK.Worker-pool2-t93] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478582087459 ./node-1/hbase-root-master-node-1.cluster.log:5775:2016-11-08 05:18:38,377 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582318376, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582318377, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5776:2016-11-08 05:18:38,382 INFO [AM.ZK.Worker-pool2-t95] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582318377, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582318382, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5777:2016-11-08 05:18:38,424 INFO [AM.ZK.Worker-pool2-t96] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582318382, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582318424, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5782:2016-11-08 05:19:17,235 INFO [B.defaultRpcServer.handler=29,queue=2,port=16000] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582318425, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582357235, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5783:2016-11-08 05:19:17,248 INFO [AM.ZK.Worker-pool2-t100] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582357235, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582357248, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5784:2016-11-08 05:19:17,250 INFO [AM.ZK.Worker-pool2-t100] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5785:2016-11-08 05:19:17,250 INFO [AM.ZK.Worker-pool2-t100] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582357248, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582357250, server=node-5.cluster,16020,1478582087459} ./node-1/hbase-root-master-node-1.cluster.log:5786:2016-11-08 05:19:17,251 INFO [AM.ZK.Worker-pool2-t100] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478582098693 ./node-1/hbase-root-master-node-1.cluster.log:5787:2016-11-08 05:19:17,251 INFO [AM.ZK.Worker-pool2-t100] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582357250, server=node-5.cluster,16020,1478582087459} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582357251, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5788:2016-11-08 05:19:17,257 INFO [AM.ZK.Worker-pool2-t101] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582357251, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582357257, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5789:2016-11-08 05:19:17,284 INFO [AM.ZK.Worker-pool2-t103] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582357257, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582357284, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5790:2016-11-08 05:19:17,286 INFO [AM.ZK.Worker-pool2-t103] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-5.cluster,16020,1478582087459 ./node-1/hbase-root-master-node-1.cluster.log:5800:2016-11-08 05:19:37,605 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582357286, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582377605, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5801:2016-11-08 05:19:37,621 INFO [AM.ZK.Worker-pool2-t107] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582377605, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582377621, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5802:2016-11-08 05:19:37,621 INFO [AM.ZK.Worker-pool2-t107] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5803:2016-11-08 05:19:37,621 INFO [AM.ZK.Worker-pool2-t107] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582377621, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582377621, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5804:2016-11-08 05:19:37,622 INFO [AM.ZK.Worker-pool2-t107] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478582098693 ./node-1/hbase-root-master-node-1.cluster.log:5805:2016-11-08 05:19:37,622 INFO [AM.ZK.Worker-pool2-t107] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582377621, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582377622, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5806:2016-11-08 05:19:37,629 INFO [AM.ZK.Worker-pool2-t108] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582377622, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582377629, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5807:2016-11-08 05:19:37,660 INFO [AM.ZK.Worker-pool2-t110] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582377629, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582377660, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5851:2016-11-08 05:20:08,179 INFO [node-1.cluster,16000,1478581182928-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582377661, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582408179, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5853:2016-11-08 05:20:08,195 INFO [AM.ZK.Worker-pool2-t102] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478582408179, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582408195, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5854:2016-11-08 05:20:08,195 INFO [AM.ZK.Worker-pool2-t102] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-1/hbase-root-master-node-1.cluster.log:5855:2016-11-08 05:20:08,195 INFO [AM.ZK.Worker-pool2-t102] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478582408195, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582408195, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5856:2016-11-08 05:20:08,198 INFO [AM.ZK.Worker-pool2-t102] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478582098693 ./node-1/hbase-root-master-node-1.cluster.log:5857:2016-11-08 05:20:08,198 INFO [AM.ZK.Worker-pool2-t102] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478582408195, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582408198, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5863:2016-11-08 05:20:08,205 INFO [AM.ZK.Worker-pool2-t100] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478582408198, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582408205, server=node-3.cluster,16020,1478582098693} ./node-1/hbase-root-master-node-1.cluster.log:5871:2016-11-08 05:20:08,239 INFO [AM.ZK.Worker-pool2-t112] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478582408205, server=node-3.cluster,16020,1478582098693} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478582408239, server=node-3.cluster,16020,1478582098693} ./node-2/hbase-root-master-node-2.cluster.log:1495:2016-11-08 03:54:54,164 INFO [node-2.cluster,16000,1478576383622_ChoreService_1] hbase.MetaTableAccessor: Deleted references in merged region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., qualifier=mergeA and qualifier=mergeB ./node-2/hbase-root-master-node-2.cluster.log:1506:2016-11-08 03:54:57,970 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577291860, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577297970, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1521:2016-11-08 03:55:11,064 INFO [AM.ZK.Worker-pool2-t14] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577297970, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577311064, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1522:2016-11-08 03:55:11,064 INFO [AM.ZK.Worker-pool2-t14] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1523:2016-11-08 03:55:11,064 INFO [AM.ZK.Worker-pool2-t14] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577311064, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577311064, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1524:2016-11-08 03:55:11,075 INFO [AM.ZK.Worker-pool2-t14] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1525:2016-11-08 03:55:11,075 INFO [AM.ZK.Worker-pool2-t14] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577311064, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577311075, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1526:2016-11-08 03:55:11,145 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577311075, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577311145, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1527:2016-11-08 03:55:11,824 INFO [AM.ZK.Worker-pool2-t17] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577311145, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577311824, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1551:2016-11-08 03:56:22,055 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577311859, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577382055, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1566:2016-11-08 03:56:30,959 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577382055, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577390959, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1567:2016-11-08 03:56:30,960 INFO [AM.ZK.Worker-pool2-t34] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1568:2016-11-08 03:56:30,960 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577390959, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577390960, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1569:2016-11-08 03:56:30,972 INFO [AM.ZK.Worker-pool2-t34] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1570:2016-11-08 03:56:30,972 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577390960, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577390972, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1571:2016-11-08 03:56:31,027 INFO [AM.ZK.Worker-pool2-t36] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577390972, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577391027, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1572:2016-11-08 03:56:31,831 INFO [AM.ZK.Worker-pool2-t37] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577391027, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577391831, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1589:2016-11-08 03:56:40,308 INFO [B.defaultRpcServer.handler=17,queue=2,port=16000] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577391836, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577400308, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1590:2016-11-08 03:56:48,437 INFO [AM.ZK.Worker-pool2-t35] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577400308, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577408437, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1591:2016-11-08 03:56:48,446 INFO [AM.ZK.Worker-pool2-t35] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1592:2016-11-08 03:56:48,446 INFO [AM.ZK.Worker-pool2-t35] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577408437, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577408446, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1593:2016-11-08 03:56:48,454 INFO [AM.ZK.Worker-pool2-t35] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577166101 ./node-2/hbase-root-master-node-2.cluster.log:1594:2016-11-08 03:56:48,454 INFO [AM.ZK.Worker-pool2-t35] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577408446, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577408454, server=node-5.cluster,16020,1478577166101} ./node-2/hbase-root-master-node-2.cluster.log:1595:2016-11-08 03:56:48,639 INFO [AM.ZK.Worker-pool2-t38] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577408454, server=node-5.cluster,16020,1478577166101} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577408639, server=node-5.cluster,16020,1478577166101} ./node-2/hbase-root-master-node-2.cluster.log:1596:2016-11-08 03:56:50,466 INFO [AM.ZK.Worker-pool2-t37] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577408639, server=node-5.cluster,16020,1478577166101} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577410466, server=node-5.cluster,16020,1478577166101} ./node-2/hbase-root-master-node-2.cluster.log:1597:2016-11-08 03:56:50,477 INFO [AM.ZK.Worker-pool2-t37] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1612:2016-11-08 03:57:14,676 INFO [ProcedureExecutor-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577410477, server=node-5.cluster,16020,1478577166101} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577434676, server=node-5.cluster,16020,1478577166101} ./node-2/hbase-root-master-node-2.cluster.log:1615:2016-11-08 03:57:14,707 INFO [node-2.cluster,16000,1478576383622-GeneralBulkAssigner-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577434702, server=node-5.cluster,16020,1478577166101} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577434707, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1616:2016-11-08 03:57:14,747 INFO [AM.ZK.Worker-pool2-t21] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577434707, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577434747, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1617:2016-11-08 03:57:27,550 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577434747, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577447550, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1618:2016-11-08 03:57:27,551 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-5.cluster,16020,1478577166101 ./node-2/hbase-root-master-node-2.cluster.log:1637:2016-11-08 03:57:51,724 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577447551, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577471724, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1645:2016-11-08 03:57:59,601 INFO [AM.ZK.Worker-pool2-t58] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577471724, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577479601, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1646:2016-11-08 03:57:59,602 INFO [AM.ZK.Worker-pool2-t58] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1647:2016-11-08 03:57:59,602 INFO [AM.ZK.Worker-pool2-t58] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577479601, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577479602, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1648:2016-11-08 03:57:59,603 INFO [AM.ZK.Worker-pool2-t58] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1649:2016-11-08 03:57:59,604 INFO [AM.ZK.Worker-pool2-t58] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577479602, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577479604, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1650:2016-11-08 03:57:59,626 INFO [AM.ZK.Worker-pool2-t21] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577479604, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577479626, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1651:2016-11-08 03:58:00,069 INFO [AM.ZK.Worker-pool2-t41] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577479626, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577480069, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1682:2016-11-08 03:59:23,686 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577480070, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577563686, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1690:2016-11-08 03:59:30,365 INFO [AM.ZK.Worker-pool2-t66] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577563686, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577570365, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1691:2016-11-08 03:59:30,365 INFO [AM.ZK.Worker-pool2-t66] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1692:2016-11-08 03:59:30,365 INFO [AM.ZK.Worker-pool2-t66] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577570365, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577570365, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1693:2016-11-08 03:59:30,366 INFO [AM.ZK.Worker-pool2-t66] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1694:2016-11-08 03:59:30,366 INFO [AM.ZK.Worker-pool2-t66] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577570365, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577570366, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1695:2016-11-08 03:59:30,382 INFO [AM.ZK.Worker-pool2-t68] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577570366, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577570382, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1696:2016-11-08 03:59:30,623 INFO [AM.ZK.Worker-pool2-t69] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577570382, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577570623, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1788:2016-11-08 04:00:52,195 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577570640, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577652195, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1796:2016-11-08 04:00:52,743 INFO [AM.ZK.Worker-pool2-t78] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577652195, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577652743, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1797:2016-11-08 04:00:52,743 INFO [AM.ZK.Worker-pool2-t78] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1798:2016-11-08 04:00:52,743 INFO [AM.ZK.Worker-pool2-t78] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577652743, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577652743, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1799:2016-11-08 04:00:52,745 INFO [AM.ZK.Worker-pool2-t78] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1800:2016-11-08 04:00:52,745 INFO [AM.ZK.Worker-pool2-t78] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577652743, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577652745, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1801:2016-11-08 04:00:52,756 INFO [AM.ZK.Worker-pool2-t65] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577652745, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577652756, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1810:2016-11-08 04:00:53,167 INFO [AM.ZK.Worker-pool2-t72] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577652756, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577653167, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1839:2016-11-08 04:02:07,667 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577653171, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577727667, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1862:2016-11-08 04:02:15,227 INFO [AM.ZK.Worker-pool2-t85] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577727667, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577735227, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1863:2016-11-08 04:02:15,227 INFO [AM.ZK.Worker-pool2-t85] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1864:2016-11-08 04:02:15,227 INFO [AM.ZK.Worker-pool2-t85] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577735227, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577735227, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1865:2016-11-08 04:02:15,234 INFO [AM.ZK.Worker-pool2-t85] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1866:2016-11-08 04:02:15,234 INFO [AM.ZK.Worker-pool2-t85] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577735227, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577735234, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1867:2016-11-08 04:02:15,244 INFO [AM.ZK.Worker-pool2-t87] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577735234, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577735244, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1868:2016-11-08 04:02:16,193 INFO [AM.ZK.Worker-pool2-t88] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577735244, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577736193, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1884:2016-11-08 04:02:22,155 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577736195, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577742155, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1900:2016-11-08 04:02:22,828 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577742155, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577742828, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1901:2016-11-08 04:02:22,828 INFO [AM.ZK.Worker-pool2-t93] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1902:2016-11-08 04:02:22,828 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577742828, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577742828, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1903:2016-11-08 04:02:22,832 INFO [AM.ZK.Worker-pool2-t93] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1904:2016-11-08 04:02:22,832 INFO [AM.ZK.Worker-pool2-t93] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577742828, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577742832, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1905:2016-11-08 04:02:22,864 INFO [AM.ZK.Worker-pool2-t95] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577742832, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577742864, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1906:2016-11-08 04:02:23,427 INFO [AM.ZK.Worker-pool2-t97] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577742864, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577743427, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1936:2016-11-08 04:03:51,745 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577743450, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577831745, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1937:2016-11-08 04:03:52,343 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577831745, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577832343, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1938:2016-11-08 04:03:52,343 INFO [AM.ZK.Worker-pool2-t106] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:1939:2016-11-08 04:03:52,343 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577832343, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577832343, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1940:2016-11-08 04:03:52,351 INFO [AM.ZK.Worker-pool2-t106] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:1941:2016-11-08 04:03:52,351 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577832343, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577832351, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1942:2016-11-08 04:03:52,399 INFO [AM.ZK.Worker-pool2-t108] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577832351, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577832399, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1949:2016-11-08 04:03:53,148 INFO [AM.ZK.Worker-pool2-t112] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577832399, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577833148, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:1974:2016-11-08 04:04:37,912 INFO [B.defaultRpcServer.handler=17,queue=2,port=16000] master.HMaster: Client=root//192.168.124.2 move hri=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., src=node-4.cluster,16020,1478575564466, dest=node-5.cluster,16020,1478577464990, running balancer ./node-2/hbase-root-master-node-2.cluster.log:1975:2016-11-08 04:04:37,914 INFO [B.defaultRpcServer.handler=17,queue=2,port=16000] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577833164, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577877914, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:2008:2016-11-08 04:04:46,024 INFO [AM.ZK.Worker-pool2-t121] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577877914, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577886024, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:2009:2016-11-08 04:04:46,024 INFO [AM.ZK.Worker-pool2-t121] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2010:2016-11-08 04:04:46,024 INFO [AM.ZK.Worker-pool2-t121] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577886024, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577886024, server=node-4.cluster,16020,1478575564466} ./node-2/hbase-root-master-node-2.cluster.log:2011:2016-11-08 04:04:46,026 INFO [AM.ZK.Worker-pool2-t121] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2012:2016-11-08 04:04:46,026 INFO [AM.ZK.Worker-pool2-t121] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577886024, server=node-4.cluster,16020,1478575564466} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577886026, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2013:2016-11-08 04:04:46,063 INFO [AM.ZK.Worker-pool2-t123] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577886026, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577886063, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2014:2016-11-08 04:04:46,955 INFO [AM.ZK.Worker-pool2-t124] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577886063, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577886955, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2015:2016-11-08 04:04:46,957 INFO [AM.ZK.Worker-pool2-t107] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-4.cluster,16020,1478575564466 ./node-2/hbase-root-master-node-2.cluster.log:2054:2016-11-08 04:05:22,035 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577886957, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577922035, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2077:2016-11-08 04:05:35,140 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478577922035, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577935140, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2078:2016-11-08 04:05:35,141 INFO [AM.ZK.Worker-pool2-t106] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2079:2016-11-08 04:05:35,141 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478577935140, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577935141, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2080:2016-11-08 04:05:35,142 INFO [AM.ZK.Worker-pool2-t106] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2081:2016-11-08 04:05:35,142 INFO [AM.ZK.Worker-pool2-t106] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478577935141, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577935142, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2082:2016-11-08 04:05:35,272 INFO [AM.ZK.Worker-pool2-t109] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478577935142, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577935272, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2083:2016-11-08 04:05:35,863 INFO [AM.ZK.Worker-pool2-t113] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478577935272, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577935863, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2137:2016-11-08 04:06:51,679 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478577935865, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578011679, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2160:2016-11-08 04:07:05,651 INFO [AM.ZK.Worker-pool2-t129] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578011679, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578025651, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2161:2016-11-08 04:07:05,651 INFO [AM.ZK.Worker-pool2-t129] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2162:2016-11-08 04:07:05,651 INFO [AM.ZK.Worker-pool2-t129] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578025651, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578025651, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2163:2016-11-08 04:07:05,653 INFO [AM.ZK.Worker-pool2-t129] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2164:2016-11-08 04:07:05,653 INFO [AM.ZK.Worker-pool2-t129] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578025651, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578025653, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2165:2016-11-08 04:07:05,667 INFO [AM.ZK.Worker-pool2-t131] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578025653, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578025667, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2166:2016-11-08 04:07:06,277 INFO [AM.ZK.Worker-pool2-t132] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578025667, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578026277, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2490:2016-11-08 04:09:51,949 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578026279, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578191949, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2496:2016-11-08 04:10:07,755 INFO [AM.ZK.Worker-pool2-t177] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578191949, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578207755, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2497:2016-11-08 04:10:07,755 INFO [AM.ZK.Worker-pool2-t177] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2498:2016-11-08 04:10:07,755 INFO [AM.ZK.Worker-pool2-t177] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578207755, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578207755, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2499:2016-11-08 04:10:07,759 INFO [AM.ZK.Worker-pool2-t177] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2500:2016-11-08 04:10:07,759 INFO [AM.ZK.Worker-pool2-t177] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578207755, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578207759, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2501:2016-11-08 04:10:07,783 INFO [AM.ZK.Worker-pool2-t178] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578207759, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578207783, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2502:2016-11-08 04:10:08,739 INFO [AM.ZK.Worker-pool2-t180] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578207807, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578208739, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2513:2016-11-08 04:11:20,610 INFO [MASTER_TABLE_OPERATIONS-node-2:16000-0] handler.DispatchMergingRegionHandler: Skip merging regions IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., IntegrationTestBigLinkedList,`\x00\x00\x00\x00\x00\x00\x00,1478578104764.aa1ea438a78e1367b48017234c6d1484., because region aa1ea438a78e1367b48017234c6d1484 has merge qualifier ./node-2/hbase-root-master-node-2.cluster.log:2538:2016-11-08 04:12:51,691 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578208759, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578371691, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2546:2016-11-08 04:13:08,115 INFO [AM.ZK.Worker-pool2-t190] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578371691, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578388115, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2547:2016-11-08 04:13:08,115 INFO [AM.ZK.Worker-pool2-t190] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2548:2016-11-08 04:13:08,115 INFO [AM.ZK.Worker-pool2-t190] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578388115, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578388115, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2549:2016-11-08 04:13:08,118 INFO [AM.ZK.Worker-pool2-t190] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2550:2016-11-08 04:13:08,118 INFO [AM.ZK.Worker-pool2-t190] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578388115, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578388118, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2551:2016-11-08 04:13:08,187 INFO [AM.ZK.Worker-pool2-t192] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578388118, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578388187, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2552:2016-11-08 04:13:09,075 INFO [AM.ZK.Worker-pool2-t193] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578388187, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578389075, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2576:2016-11-08 04:14:21,477 INFO [node-2.cluster,16000,1478576383622-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578389095, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578461477, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2584:2016-11-08 04:14:32,422 INFO [AM.ZK.Worker-pool2-t210] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578461477, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578472422, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2585:2016-11-08 04:14:32,422 INFO [AM.ZK.Worker-pool2-t210] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2586:2016-11-08 04:14:32,423 INFO [AM.ZK.Worker-pool2-t210] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578472422, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578472422, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2587:2016-11-08 04:14:32,425 INFO [AM.ZK.Worker-pool2-t210] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2588:2016-11-08 04:14:32,425 INFO [AM.ZK.Worker-pool2-t210] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578472422, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578472425, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2589:2016-11-08 04:14:32,436 INFO [AM.ZK.Worker-pool2-t212] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578472425, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578472436, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2590:2016-11-08 04:14:32,844 INFO [AM.ZK.Worker-pool2-t213] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578472436, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578472844, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2676:2016-11-08 04:14:42,844 INFO [B.defaultRpcServer.handler=23,queue=2,port=16000] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578472851, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578482844, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2677:2016-11-08 04:14:43,755 INFO [AM.ZK.Worker-pool2-t203] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578482844, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578483755, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2678:2016-11-08 04:14:43,755 INFO [AM.ZK.Worker-pool2-t203] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2679:2016-11-08 04:14:43,755 INFO [AM.ZK.Worker-pool2-t203] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578483755, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578483755, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2680:2016-11-08 04:14:43,767 INFO [AM.ZK.Worker-pool2-t203] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2681:2016-11-08 04:14:43,767 INFO [AM.ZK.Worker-pool2-t203] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578483755, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578483767, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2682:2016-11-08 04:14:43,779 INFO [AM.ZK.Worker-pool2-t203] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578483767, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578483779, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2687:2016-11-08 04:14:44,443 INFO [AM.ZK.Worker-pool2-t206] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578483781, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578484443, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2724:2016-11-08 04:14:53,755 INFO [node-2.cluster,16000,1478576383622_ChoreService_1] master.HMaster: balance hri=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., src=node-5.cluster,16020,1478577464990, dest=node-3.cluster,16020,1478578389506 ./node-2/hbase-root-master-node-2.cluster.log:2725:2016-11-08 04:14:53,756 INFO [node-2.cluster,16000,1478576383622_ChoreService_1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578484444, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578493756, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2735:2016-11-08 04:14:56,031 INFO [AM.ZK.Worker-pool2-t219] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478578493756, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578496031, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2736:2016-11-08 04:14:56,031 INFO [AM.ZK.Worker-pool2-t219] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:2737:2016-11-08 04:14:56,031 INFO [AM.ZK.Worker-pool2-t219] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478578496031, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578496031, server=node-5.cluster,16020,1478577464990} ./node-2/hbase-root-master-node-2.cluster.log:2738:2016-11-08 04:14:56,032 INFO [AM.ZK.Worker-pool2-t219] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478578389506 ./node-2/hbase-root-master-node-2.cluster.log:2739:2016-11-08 04:14:56,033 INFO [AM.ZK.Worker-pool2-t219] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478578496031, server=node-5.cluster,16020,1478577464990} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578496033, server=node-3.cluster,16020,1478578389506} ./node-2/hbase-root-master-node-2.cluster.log:2740:2016-11-08 04:14:56,074 INFO [AM.ZK.Worker-pool2-t220] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478578496033, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578496074, server=node-3.cluster,16020,1478578389506} ./node-2/hbase-root-master-node-2.cluster.log:2741:2016-11-08 04:14:57,108 INFO [AM.ZK.Worker-pool2-t222] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478578496074, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478578497108, server=node-3.cluster,16020,1478578389506} ./node-2/hbase-root-master-node-2.cluster.log:2742:2016-11-08 04:14:57,115 INFO [AM.ZK.Worker-pool2-t222] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-5.cluster,16020,1478577464990 ./node-2/hbase-root-master-node-2.cluster.log:2935:2016-11-08 04:59:46,929 INFO [node-2:16000.activeMasterManager] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581186929, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581186929, server=node-3.cluster,16020,1478578389506} ./node-2/hbase-root-master-node-2.cluster.log:3013:2016-11-08 04:59:47,656 INFO [node-2.cluster,16000,1478578635630-GeneralBulkAssigner-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581187647, server=node-3.cluster,16020,1478578389506} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581187656, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3014:2016-11-08 04:59:47,682 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581187656, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581187682, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3016:2016-11-08 04:59:48,191 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581187682, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581188191, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3017:2016-11-08 04:59:48,197 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates: Offlined 393d2bfd8b1c52ce08540306659624f2 from node-3.cluster,16020,1478578389506 ./node-2/hbase-root-master-node-2.cluster.log:3070:2016-11-08 05:00:38,102 INFO [node-2.cluster,16000,1478578635630-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581188197, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581238102, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3082:2016-11-08 05:00:38,132 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581238102, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581238132, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3083:2016-11-08 05:00:38,132 INFO [AM.ZK.Worker-pool2-t9] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:3084:2016-11-08 05:00:38,132 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581238132, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581238132, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3085:2016-11-08 05:00:38,134 INFO [AM.ZK.Worker-pool2-t9] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478580753290 ./node-2/hbase-root-master-node-2.cluster.log:3086:2016-11-08 05:00:38,134 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581238132, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581238134, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3089:2016-11-08 05:00:38,143 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581238134, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581238143, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3092:2016-11-08 05:00:38,384 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581238143, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581238384, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3102:2016-11-08 05:02:07,331 INFO [node-2.cluster,16000,1478578635630-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581238386, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581327331, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3118:2016-11-08 05:02:07,492 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581327331, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581327492, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3119:2016-11-08 05:02:07,493 INFO [AM.ZK.Worker-pool2-t34] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:3120:2016-11-08 05:02:07,493 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581327492, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581327493, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3121:2016-11-08 05:02:07,494 INFO [AM.ZK.Worker-pool2-t34] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478580753290 ./node-2/hbase-root-master-node-2.cluster.log:3122:2016-11-08 05:02:07,494 INFO [AM.ZK.Worker-pool2-t34] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581327493, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581327494, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3123:2016-11-08 05:02:07,499 INFO [AM.ZK.Worker-pool2-t35] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581327494, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581327499, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3124:2016-11-08 05:02:07,589 INFO [AM.ZK.Worker-pool2-t37] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581327499, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581327589, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3132:2016-11-08 05:02:08,205 INFO [node-2.cluster,16000,1478578635630-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581327592, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581328205, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3148:2016-11-08 05:02:08,468 INFO [AM.ZK.Worker-pool2-t32] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581328205, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581328468, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3149:2016-11-08 05:02:08,468 INFO [AM.ZK.Worker-pool2-t32] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:3150:2016-11-08 05:02:08,468 INFO [AM.ZK.Worker-pool2-t32] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581328468, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581328468, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3151:2016-11-08 05:02:08,470 INFO [AM.ZK.Worker-pool2-t32] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478580753290 ./node-2/hbase-root-master-node-2.cluster.log:3152:2016-11-08 05:02:08,470 INFO [AM.ZK.Worker-pool2-t32] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581328468, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581328470, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3153:2016-11-08 05:02:08,474 INFO [AM.ZK.Worker-pool2-t32] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581328470, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581328474, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3154:2016-11-08 05:02:08,549 INFO [AM.ZK.Worker-pool2-t36] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581328474, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581328549, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3163:2016-11-08 05:03:37,861 INFO [node-2.cluster,16000,1478578635630-org.apache.hadoop.hbase.master.BulkReOpen-1] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581328551, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581417861, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3179:2016-11-08 05:03:38,115 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_CLOSE, ts=1478581417861, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581418115, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3180:2016-11-08 05:03:38,115 INFO [AM.ZK.Worker-pool2-t54] master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region {ENCODED => 393d2bfd8b1c52ce08540306659624f2, NAME => 'IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.', STARTKEY => '', ENDKEY => '`\x00\x00\x00\x00\x00\x00\x00'} ./node-2/hbase-root-master-node-2.cluster.log:3181:2016-11-08 05:03:38,115 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=CLOSED, ts=1478581418115, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581418115, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3182:2016-11-08 05:03:38,116 INFO [AM.ZK.Worker-pool2-t54] master.AssignmentManager: Assigning IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. to node-3.cluster,16020,1478580753290 ./node-2/hbase-root-master-node-2.cluster.log:3183:2016-11-08 05:03:38,116 INFO [AM.ZK.Worker-pool2-t54] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OFFLINE, ts=1478581418115, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581418116, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3184:2016-11-08 05:03:38,121 INFO [AM.ZK.Worker-pool2-t55] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=PENDING_OPEN, ts=1478581418116, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581418120, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-master-node-2.cluster.log:3185:2016-11-08 05:03:38,206 INFO [AM.ZK.Worker-pool2-t57] master.RegionStates: Transition {393d2bfd8b1c52ce08540306659624f2 state=OPENING, ts=1478581418121, server=node-3.cluster,16020,1478580753290} to {393d2bfd8b1c52ce08540306659624f2 state=OPEN, ts=1478581418206, server=node-3.cluster,16020,1478580753290} ./node-2/hbase-root-regionserver-node-2.cluster.log:2665:2016-11-08 03:57:12,692 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005286.temp to hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005402 ./node-2/hbase-root-regionserver-node-2.cluster.log:5587:2016-11-08 04:39:43,001 INFO [StoreFileOpenerThread-meta-1] regionserver.StoreFile: Bloom filter turned off by CF config for 7ec91e98f080464fa58e8bd17e5c5bbc.393d2bfd8b1c52ce08540306659624f2 ./node-2/hbase-root-regionserver-node-2.cluster.log:5589:2016-11-08 04:39:43,018 INFO [StoreFileOpenerThread-meta-1] regionserver.StoreFile: Bloom filter turned off by CF config for ab66df267f27474ba1f32a244117757c.393d2bfd8b1c52ce08540306659624f2 ./node-2/hbase-root-regionserver-node-2.cluster.log:5599:2016-11-08 04:39:43,067 INFO [StoreFileOpenerThread-tiny-1] regionserver.StoreFile: HFile Bloom filter type for 08241caa0a35450ca7ff92ae907b242c.393d2bfd8b1c52ce08540306659624f2: NONE, but ROWCOL specified in column family configuration ./node-2/hbase-root-regionserver-node-2.cluster.log:5654:2016-11-08 04:39:50,672 INFO [regionserver/node-2.cluster/192.168.124.3:16020-longCompactions-1478579089677] regionserver.StoreFile: Bloom filter turned off by CF config for ab66df267f27474ba1f32a244117757c.393d2bfd8b1c52ce08540306659624f2 ./node-2/hbase-root-regionserver-node-2.cluster.log:5656:2016-11-08 04:39:50,677 INFO [regionserver/node-2.cluster/192.168.124.3:16020-longCompactions-1478579089677] regionserver.StoreFile: Bloom filter turned off by CF config for 7ec91e98f080464fa58e8bd17e5c5bbc.393d2bfd8b1c52ce08540306659624f2 ./node-2/hbase-root-regionserver-node-2.cluster.log:5676:2016-11-08 04:41:06,083 INFO [regionserver/node-2.cluster/192.168.124.3:16020-longCompactions-1478579089677] regionserver.StoreFile: HFile Bloom filter type for 08241caa0a35450ca7ff92ae907b242c.393d2bfd8b1c52ce08540306659624f2: NONE, but ROWCOL specified in column family configuration ./node-2/hbase-root-regionserver-node-2.cluster.log:8460:2016-11-08 05:08:17,363 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-2/hbase-root-regionserver-node-2.cluster.log:8461:2016-11-08 05:08:17,370 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8462:2016-11-08 05:08:17,370 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8464:2016-11-08 05:08:17,379 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8465:2016-11-08 05:08:17,379 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8466:2016-11-08 05:08:17,387 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8467:2016-11-08 05:08:17,387 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8468:2016-11-08 05:08:17,402 INFO [RS_OPEN_REGION-node-2:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19218 ./node-2/hbase-root-regionserver-node-2.cluster.log:8469:2016-11-08 05:08:17,405 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-2/hbase-root-regionserver-node-2.cluster.log:8470:2016-11-08 05:08:17,408 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-2.cluster,16020,1478581647752 ./node-2/hbase-root-regionserver-node-2.cluster.log:8683:2016-11-08 05:14:43,831 INFO [PriorityRpcServer.handler=0,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-2/hbase-root-regionserver-node-2.cluster.log:8693:2016-11-08 05:14:43,924 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8695:2016-11-08 05:14:43,931 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8702:2016-11-08 05:14:43,990 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8705:2016-11-08 05:14:43,990 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8706:2016-11-08 05:14:44,004 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=1, currentSize=13168384, freeSize=12825543936, maxSize=12838712320, heapSize=13168384, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-2/hbase-root-regionserver-node-2.cluster.log:8707:2016-11-08 05:14:44,004 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-2/hbase-root-regionserver-node-2.cluster.log:8716:2016-11-08 05:14:44,036 INFO [RS_OPEN_REGION-node-2:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19224 ./node-2/hbase-root-regionserver-node-2.cluster.log:8719:2016-11-08 05:14:44,049 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-2/hbase-root-regionserver-node-2.cluster.log:8764:2016-11-08 05:14:48,254 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-2.cluster,16020,1478581987881 ./node-3/hbase-root-regionserver-node-3.cluster.log:2263:2016-11-08 03:57:14,510 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005403.temp to hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005415 ./node-3/hbase-root-regionserver-node-3.cluster.log:3527:2016-11-08 04:14:56,039 INFO [PriorityRpcServer.handler=10,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3528:2016-11-08 04:14:56,113 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3529:2016-11-08 04:14:56,113 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3530:2016-11-08 04:14:56,143 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3531:2016-11-08 04:14:56,143 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3533:2016-11-08 04:14:56,475 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3534:2016-11-08 04:14:56,476 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3535:2016-11-08 04:14:56,692 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3536:2016-11-08 04:14:56,692 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3537:2016-11-08 04:14:56,695 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3538:2016-11-08 04:14:56,695 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3539:2016-11-08 04:14:56,704 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3540:2016-11-08 04:14:56,704 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3543:2016-11-08 04:14:57,062 INFO [RS_OPEN_REGION-node-3:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=14461 ./node-3/hbase-root-regionserver-node-3.cluster.log:3544:2016-11-08 04:14:57,080 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3545:2016-11-08 04:14:57,103 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478578389506 ./node-3/hbase-root-regionserver-node-3.cluster.log:3548:2016-11-08 04:14:57,934 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3549:2016-11-08 04:14:57,934 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=6.6 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3552:2016-11-08 04:14:59,135 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 9a38850095ee45a680cbfae0520a4ef4(size=6.5 M), total size for store is 995.0 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3553:2016-11-08 04:14:59,135 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=6.6 M, priority=-6, time=730483335206120; duration=1sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3554:2016-11-08 04:14:59,239 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3555:2016-11-08 04:14:59,240 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=3.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3561:2016-11-08 04:15:03,826 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:3564:2016-11-08 04:15:08,501 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 7e73fbde573e4112bb89eb43cf0df95e(size=3.5 M), total size for store is 728.1 M. This selection was in queue for 0sec, and took 9sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3565:2016-11-08 04:15:08,501 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=3.0 M, priority=-5, time=730484640630309; duration=9sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3566:2016-11-08 04:15:08,641 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3567:2016-11-08 04:15:08,642 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=130.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3585:2016-11-08 04:15:27,918 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into c6c43d28f9054fdebae38962380aae3c(size=152.4 M), total size for store is 1016.6 M. This selection was in queue for 0sec, and took 19sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3586:2016-11-08 04:15:27,918 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=130.7 M, priority=-4, time=730494042642187; duration=19sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3587:2016-11-08 04:15:27,923 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3588:2016-11-08 04:15:27,923 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=2.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3589:2016-11-08 04:15:28,327 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 765b4d0abe144e08a676328e8e0d7bdd(size=2.5 M), total size for store is 444.0 M. This selection was in queue for 0sec, and took 0sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3590:2016-11-08 04:15:28,327 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=2.0 M, priority=-4, time=730513324259691; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3591:2016-11-08 04:15:28,332 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3592:2016-11-08 04:15:28,332 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=37.4 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3594:2016-11-08 04:15:40,251 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3597:2016-11-08 04:15:42,580 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3598:2016-11-08 04:15:42,581 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 5 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=337.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3599:2016-11-08 04:16:11,599 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6d874dabdac64e77a6928de56eb21139(size=36.0 M), total size for store is 726.7 M. This selection was in queue for 0sec, and took 43sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3600:2016-11-08 04:16:11,599 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=4, fileSize=37.4 M, priority=-3, time=730513733551944; duration=43sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3601:2016-11-08 04:16:11,602 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3602:2016-11-08 04:16:11,603 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3603:2016-11-08 04:16:18,139 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 5 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 09ce881f507c45f4916c9815ecca8bb1(size=353.8 M), total size for store is 1.0 G. This selection was in queue for 0sec, and took 35sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3604:2016-11-08 04:16:18,139 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=5, fileSize=337.5 M, priority=-2, time=730527981755000; duration=35sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3605:2016-11-08 04:16:18,140 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3606:2016-11-08 04:16:18,140 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=178.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3607:2016-11-08 04:16:34,599 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Waited 90781ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3609:2016-11-08 04:16:35,647 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15059, memsize=135.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c850cbe09e0f4d0897867f22f0556a0a ./node-3/hbase-root-regionserver-node-3.cluster.log:3610:2016-11-08 04:16:38,911 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15059, memsize=250.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ad401b3f213b49c2bb27abac9d54c3bb ./node-3/hbase-root-regionserver-node-3.cluster.log:3611:2016-11-08 04:16:42,368 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15059, memsize=70.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d7069f692fe04f4cb02ceeadc18fb684 ./node-3/hbase-root-regionserver-node-3.cluster.log:3612:2016-11-08 04:16:42,411 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/c850cbe09e0f4d0897867f22f0556a0a, entries=421646, sequenceid=15059, filesize=12.3 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3613:2016-11-08 04:16:42,420 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/ad401b3f213b49c2bb27abac9d54c3bb, entries=1264938, sequenceid=15059, filesize=26.6 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3614:2016-11-08 04:16:42,445 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/d7069f692fe04f4cb02ceeadc18fb684, entries=421646, sequenceid=15059, filesize=8.2 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3615:2016-11-08 04:16:42,459 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~456.80 MB/478989856, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7859ms, sequenceid=15059, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:3621:2016-11-08 04:16:43,268 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into aefde47c280d4c838df6999e036e0804(size=204.4 M), total size for store is 1.1 G. This selection was in queue for 37sec, and took 25sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3622:2016-11-08 04:16:43,269 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=178.7 M, priority=1, time=730525716998438; duration=25sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3623:2016-11-08 04:16:43,280 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3624:2016-11-08 04:16:43,280 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 5 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=96.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3643:2016-11-08 04:17:07,022 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into e304e17e513742719abaa50fc439f45b(size=46.1 M), total size for store is 740.2 M. This selection was in queue for 0sec, and took 55sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3644:2016-11-08 04:17:07,022 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=44.9 M, priority=0, time=730557003735492; duration=55sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3648:2016-11-08 04:17:22,209 INFO [PriorityRpcServer.handler=9,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:3650:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:3660:2016-11-08 04:17:22,996 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=5, fileSize=96.5 M (14.7 M, 17.2 M, 16.2 M, 36.0 M, 12.3 M), priority=-1, time=730588681114004; duration=39sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3661:2016-11-08 04:17:22,997 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-3/hbase-root-regionserver-node-3.cluster.log:3662:2016-11-08 04:17:23,007 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:3663:2016-11-08 04:17:23,013 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:3664:2016-11-08 04:17:23,014 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-3/hbase-root-regionserver-node-3.cluster.log:3665:2016-11-08 04:17:23,014 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-3/hbase-root-regionserver-node-3.cluster.log:3666:2016-11-08 04:17:23,020 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:3669:2016-11-08 04:17:23,040 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3670:2016-11-08 04:17:23,075 INFO [PriorityRpcServer.handler=15,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3672:2016-11-08 04:17:23,087 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3673:2016-11-08 04:17:23,087 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3674:2016-11-08 04:17:23,089 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3675:2016-11-08 04:17:23,089 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3676:2016-11-08 04:17:23,252 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3677:2016-11-08 04:17:23,252 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3678:2016-11-08 04:17:23,396 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3679:2016-11-08 04:17:23,397 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3680:2016-11-08 04:17:23,400 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3681:2016-11-08 04:17:23,400 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3682:2016-11-08 04:17:23,402 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3683:2016-11-08 04:17:23,402 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3685:2016-11-08 04:17:23,825 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=15065 ./node-3/hbase-root-regionserver-node-3.cluster.log:3686:2016-11-08 04:17:23,859 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3687:2016-11-08 04:17:23,869 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478578389506 ./node-3/hbase-root-regionserver-node-3.cluster.log:3701:2016-11-08 04:17:24,365 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3702:2016-11-08 04:17:24,365 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=21.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3724:2016-11-08 04:17:27,758 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=4, fileSize=50.3 M, priority=1, time=730525729913321; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3727:2016-11-08 04:17:27,787 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3728:2016-11-08 04:17:27,787 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 8 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=322.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3729:2016-11-08 04:17:27,842 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:3741:2016-11-08 04:17:34,147 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 99c68a40e3e3467c9a6ee95c20d4a272(size=24.0 M), total size for store is 454.6 M. This selection was in queue for 0sec, and took 9sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3742:2016-11-08 04:17:34,147 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=21.5 M, priority=-3, time=730629765917457; duration=9sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3743:2016-11-08 04:17:34,171 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3744:2016-11-08 04:17:34,171 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=48.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3793:2016-11-08 04:17:40,250 INFO [PriorityRpcServer.handler=16,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3804:2016-11-08 04:17:41,317 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 4ec4b123403b4c1a8f28b158f6df47ca(size=42.9 M), total size for store is 448.8 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3805:2016-11-08 04:17:41,331 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=48.7 M, priority=-1, time=730639571917762; duration=7sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3849:2016-11-08 04:17:42,937 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15304, memsize=97.7 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/152257b225844d4fac5c598cc435e042 ./node-3/hbase-root-regionserver-node-3.cluster.log:3856:2016-11-08 04:17:47,288 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15304, memsize=181.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a4f32e93f6d0421cbf06dcd05539b57e ./node-3/hbase-root-regionserver-node-3.cluster.log:3858:2016-11-08 04:17:48,341 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15304, memsize=51.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2347aa3935b5495a98c9509b5ceb66fc ./node-3/hbase-root-regionserver-node-3.cluster.log:3859:2016-11-08 04:17:48,399 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/152257b225844d4fac5c598cc435e042, entries=304748, sequenceid=15304, filesize=7.6 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3860:2016-11-08 04:17:48,577 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/a4f32e93f6d0421cbf06dcd05539b57e, entries=914244, sequenceid=15304, filesize=19.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3863:2016-11-08 04:17:48,611 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/2347aa3935b5495a98c9509b5ceb66fc, entries=304748, sequenceid=15304, filesize=6.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3864:2016-11-08 04:17:48,679 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~330.16 MB/346193728, currentsize=142.18 MB/149082960 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6884ms, sequenceid=15304, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:3866:2016-11-08 04:17:49,781 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15431, memsize=45.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d5742150b79a4c5cb1d7ebbb64c5d17d ./node-3/hbase-root-regionserver-node-3.cluster.log:3867:2016-11-08 04:17:51,435 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15431, memsize=83.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/aaccb69d93784e8d997c2e9eef952fd5 ./node-3/hbase-root-regionserver-node-3.cluster.log:3868:2016-11-08 04:17:52,201 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15431, memsize=23.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b37df4d98d0347729204789bd6d788ef ./node-3/hbase-root-regionserver-node-3.cluster.log:3869:2016-11-08 04:17:52,240 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/d5742150b79a4c5cb1d7ebbb64c5d17d, entries=140431, sequenceid=15431, filesize=3.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3870:2016-11-08 04:17:52,267 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/aaccb69d93784e8d997c2e9eef952fd5, entries=421293, sequenceid=15431, filesize=8.6 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3872:2016-11-08 04:17:52,284 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/b37df4d98d0347729204789bd6d788ef, entries=140431, sequenceid=15431, filesize=2.8 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3873:2016-11-08 04:17:52,298 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~152.14 MB/159529616, currentsize=76.74 MB/80465152 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3542ms, sequenceid=15431, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:3877:2016-11-08 04:17:54,311 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:3889:2016-11-08 04:18:51,603 INFO [PriorityRpcServer.handler=0,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:3891:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:3901:2016-11-08 04:18:52,926 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=8, fileSize=322.7 M (126.6 M, 53.6 M, 46.1 M, 14.7 M, 17.2 M, 16.2 M, 36.0 M, 12.3 M), priority=2, time=730633188323319; duration=1mins, 25sec ./node-3/hbase-root-regionserver-node-3.cluster.log:3902:2016-11-08 04:18:52,927 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3908:2016-11-08 04:18:53,807 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15703, memsize=100.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a0a9c55219e14ef3be085b050133168f ./node-3/hbase-root-regionserver-node-3.cluster.log:3909:2016-11-08 04:18:55,984 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15703, memsize=186.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ba126da366054ec2b5af27d744510f69 ./node-3/hbase-root-regionserver-node-3.cluster.log:3910:2016-11-08 04:18:56,595 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=15703, memsize=52.7 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e511fbc3cd1545659bb49016a711fbac ./node-3/hbase-root-regionserver-node-3.cluster.log:3911:2016-11-08 04:18:56,607 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/a0a9c55219e14ef3be085b050133168f, entries=314040, sequenceid=15703, filesize=7.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3912:2016-11-08 04:18:56,613 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/ba126da366054ec2b5af27d744510f69, entries=942120, sequenceid=15703, filesize=19.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3913:2016-11-08 04:18:56,618 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e511fbc3cd1545659bb49016a711fbac, entries=314040, sequenceid=15703, filesize=6.2 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3914:2016-11-08 04:18:56,638 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Finished memstore flush of ~340.22 MB/356749440, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3711ms, sequenceid=15703, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:3915:2016-11-08 04:18:56,638 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-3/hbase-root-regionserver-node-3.cluster.log:3916:2016-11-08 04:18:56,647 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:3917:2016-11-08 04:18:56,654 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:3918:2016-11-08 04:18:56,654 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-3/hbase-root-regionserver-node-3.cluster.log:3919:2016-11-08 04:18:56,654 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-3/hbase-root-regionserver-node-3.cluster.log:3920:2016-11-08 04:18:56,663 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:3921:2016-11-08 04:18:56,683 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3922:2016-11-08 04:18:56,699 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3923:2016-11-08 04:18:56,736 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3924:2016-11-08 04:18:56,736 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3925:2016-11-08 04:18:56,737 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3926:2016-11-08 04:18:56,737 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3927:2016-11-08 04:18:56,902 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3928:2016-11-08 04:18:56,903 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3929:2016-11-08 04:18:56,969 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3930:2016-11-08 04:18:56,970 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3931:2016-11-08 04:18:56,971 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3932:2016-11-08 04:18:56,972 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3933:2016-11-08 04:18:56,977 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:3934:2016-11-08 04:18:56,977 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:3937:2016-11-08 04:18:57,160 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=15707 ./node-3/hbase-root-regionserver-node-3.cluster.log:3938:2016-11-08 04:18:57,171 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3939:2016-11-08 04:18:57,183 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478578389506 ./node-3/hbase-root-regionserver-node-3.cluster.log:3953:2016-11-08 04:18:57,633 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3954:2016-11-08 04:18:57,633 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=19.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3969:2016-11-08 04:18:58,493 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:3970:2016-11-08 04:18:58,493 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=15.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:3972:2016-11-08 04:19:00,088 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 9ef56abdec2c4b189f530707773bd3c4(size=17.6 M), total size for store is 466.4 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:3973:2016-11-08 04:19:00,088 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=15.0 M, priority=-2, time=730723894170980; duration=1sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4064:2016-11-08 04:19:15,943 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:4078:2016-11-08 04:19:36,736 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ad96c6bf608b4795b8435fbcb9fad49c(size=25.5 M), total size for store is 765.7 M. This selection was in queue for 0sec, and took 39sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4079:2016-11-08 04:19:36,736 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=19.0 M, priority=-2, time=730723034605643; duration=39sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4084:2016-11-08 04:19:38,319 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16118, memsize=151.9 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c4c33b0cbbe44edfb3720f49d881cdd7 ./node-3/hbase-root-regionserver-node-3.cluster.log:4090:2016-11-08 04:19:40,235 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4093:2016-11-08 04:19:42,038 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16118, memsize=282.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/41b34958eff54c6b97b3803fce0296ae ./node-3/hbase-root-regionserver-node-3.cluster.log:4099:2016-11-08 04:19:43,159 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16118, memsize=79.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/399e8eb2bf2e4952b5e6c566174843d3 ./node-3/hbase-root-regionserver-node-3.cluster.log:4100:2016-11-08 04:19:43,171 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/c4c33b0cbbe44edfb3720f49d881cdd7, entries=474065, sequenceid=16118, filesize=12.1 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4101:2016-11-08 04:19:43,188 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/41b34958eff54c6b97b3803fce0296ae, entries=1422195, sequenceid=16118, filesize=29.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4102:2016-11-08 04:19:43,201 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/399e8eb2bf2e4952b5e6c566174843d3, entries=474065, sequenceid=16118, filesize=9.4 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4103:2016-11-08 04:19:43,203 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~513.59 MB/538537840, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6419ms, sequenceid=16118, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4109:2016-11-08 04:20:21,518 INFO [PriorityRpcServer.handler=12,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:4111:2016-11-08 04:20:21,575 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16123, memsize=342.9 K, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ea9de4a55434459189018f01b2f6acb0 ./node-3/hbase-root-regionserver-node-3.cluster.log:4112:2016-11-08 04:20:22,030 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16123, memsize=636.8 K, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/cddcb52a771946c8b055b906942a9688 ./node-3/hbase-root-regionserver-node-3.cluster.log:4113:2016-11-08 04:20:22,057 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16123, memsize=179.6 K, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1dfc59ec36ee4354b822d48b35892121 ./node-3/hbase-root-regionserver-node-3.cluster.log:4114:2016-11-08 04:20:22,065 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ea9de4a55434459189018f01b2f6acb0, entries=1045, sequenceid=16123, filesize=23.1 K ./node-3/hbase-root-regionserver-node-3.cluster.log:4115:2016-11-08 04:20:22,079 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/cddcb52a771946c8b055b906942a9688, entries=3135, sequenceid=16123, filesize=63.1 K ./node-3/hbase-root-regionserver-node-3.cluster.log:4116:2016-11-08 04:20:22,088 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/1dfc59ec36ee4354b822d48b35892121, entries=1045, sequenceid=16123, filesize=20.8 K ./node-3/hbase-root-regionserver-node-3.cluster.log:4117:2016-11-08 04:20:22,099 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Finished memstore flush of ~1.13 MB/1187120, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 580ms, sequenceid=16123, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4118:2016-11-08 04:20:22,099 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-3/hbase-root-regionserver-node-3.cluster.log:4119:2016-11-08 04:20:22,107 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:4120:2016-11-08 04:20:22,113 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:4121:2016-11-08 04:20:22,114 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-3/hbase-root-regionserver-node-3.cluster.log:4122:2016-11-08 04:20:22,114 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-3/hbase-root-regionserver-node-3.cluster.log:4123:2016-11-08 04:20:22,132 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:4124:2016-11-08 04:20:22,148 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4125:2016-11-08 04:20:22,163 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4126:2016-11-08 04:20:22,173 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4127:2016-11-08 04:20:22,173 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4128:2016-11-08 04:20:22,174 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4129:2016-11-08 04:20:22,174 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4130:2016-11-08 04:20:22,276 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4131:2016-11-08 04:20:22,276 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4132:2016-11-08 04:20:22,330 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4133:2016-11-08 04:20:22,330 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4134:2016-11-08 04:20:22,331 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4135:2016-11-08 04:20:22,331 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4136:2016-11-08 04:20:22,332 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:4137:2016-11-08 04:20:22,332 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:4139:2016-11-08 04:20:22,413 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=16127 ./node-3/hbase-root-regionserver-node-3.cluster.log:4140:2016-11-08 04:20:22,423 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4141:2016-11-08 04:20:22,433 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478578389506 ./node-3/hbase-root-regionserver-node-3.cluster.log:4155:2016-11-08 04:20:22,608 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4156:2016-11-08 04:20:22,608 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=49.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4171:2016-11-08 04:20:23,901 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4172:2016-11-08 04:20:23,901 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 4 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=58.3 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4201:2016-11-08 04:20:32,926 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 4 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 13c8a8b0b7c146d1ae0b237c7ac5b97f(size=49.1 M), total size for store is 1.1 G. This selection was in queue for 0sec, and took 9sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4202:2016-11-08 04:20:32,927 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=4, fileSize=58.3 M, priority=-2, time=730809302347440; duration=9sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4203:2016-11-08 04:20:32,931 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4204:2016-11-08 04:20:32,931 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=27.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4249:2016-11-08 04:20:35,243 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 979bee510d5246389432e2cf8415f75b(size=29.4 M), total size for store is 478.2 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4250:2016-11-08 04:20:35,243 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=27.0 M, priority=-2, time=730818332369237; duration=2sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4278:2016-11-08 04:20:43,597 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:4283:2016-11-08 04:21:38,977 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into f1b253c0c59546428e1cd30e2adf3a67(size=56.6 M), total size for store is 784.5 M. This selection was in queue for 0sec, and took 1mins, 16sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4284:2016-11-08 04:21:38,977 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=4, fileSize=49.9 M, priority=-2, time=730808009582880; duration=1mins, 16sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4303:2016-11-08 04:21:41,071 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16545, memsize=152.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8bb75bc7994b45f3a13084f8b202a6bc ./node-3/hbase-root-regionserver-node-3.cluster.log:4327:2016-11-08 04:21:44,400 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4328:2016-11-08 04:21:44,400 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=60.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4329:2016-11-08 04:21:44,950 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16545, memsize=283.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3e44ccf49a21402f8f4d7a60022c5cdd ./node-3/hbase-root-regionserver-node-3.cluster.log:4330:2016-11-08 04:21:46,184 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16545, memsize=79.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/46d6b87e96f34bb790c7d24da51fe90c ./node-3/hbase-root-regionserver-node-3.cluster.log:4331:2016-11-08 04:21:46,240 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/8bb75bc7994b45f3a13084f8b202a6bc, entries=475636, sequenceid=16545, filesize=12.1 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4332:2016-11-08 04:21:46,273 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/3e44ccf49a21402f8f4d7a60022c5cdd, entries=1426908, sequenceid=16545, filesize=30.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4333:2016-11-08 04:21:46,304 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/46d6b87e96f34bb790c7d24da51fe90c, entries=475636, sequenceid=16545, filesize=9.4 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4334:2016-11-08 04:21:46,305 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~515.29 MB/540322496, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6547ms, sequenceid=16545, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4350:2016-11-08 04:21:50,413 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4351:2016-11-08 04:21:50,413 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=48.2 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4356:2016-11-08 04:21:51,916 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into d33c2b52ea45491e9cdf89334c8848ee(size=58.0 M), total size for store is 484.7 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4357:2016-11-08 04:21:51,916 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=60.9 M, priority=0, time=730889801292686; duration=7sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4358:2016-11-08 04:21:51,919 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4359:2016-11-08 04:21:51,919 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=94.8 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4379:2016-11-08 04:22:06,835 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2b5034d0fe1149d4951b7b7fd998f899(size=88.9 M), total size for store is 1.2 G. This selection was in queue for 0sec, and took 14sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4380:2016-11-08 04:22:06,835 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=94.8 M, priority=0, time=730897319931566; duration=14sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4381:2016-11-08 04:22:06,835 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=7, fileSize=1.1 G, priority=1, time=730645684322798; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4382:2016-11-08 04:22:06,835 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=6, fileSize=136.7 M, priority=1, time=730645696875669; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4386:2016-11-08 04:22:06,836 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=48.2 M, priority=1, time=730765665415653; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4387:2016-11-08 04:22:06,836 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=47.3 M, priority=1, time=730765675876327; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4388:2016-11-08 04:22:06,836 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=60.9 M, priority=1, time=730765682630224; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4395:2016-11-08 04:22:06,840 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4396:2016-11-08 04:22:06,840 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=104.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4423:2016-11-08 04:22:31,073 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16931, memsize=37.9 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/725843879ea44fa0b4628218be8cdbf5 ./node-3/hbase-root-regionserver-node-3.cluster.log:4424:2016-11-08 04:22:32,752 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16931, memsize=70.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8a03ed48fe7e4bc084a3a79c904435f6 ./node-3/hbase-root-regionserver-node-3.cluster.log:4427:2016-11-08 04:22:33,251 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=16931, memsize=19.9 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7c224980df264abb93a6d50f2a977493 ./node-3/hbase-root-regionserver-node-3.cluster.log:4429:2016-11-08 04:22:33,360 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/725843879ea44fa0b4628218be8cdbf5, entries=118388, sequenceid=16931, filesize=3.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4430:2016-11-08 04:22:33,391 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/8a03ed48fe7e4bc084a3a79c904435f6, entries=355164, sequenceid=16931, filesize=7.3 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4431:2016-11-08 04:22:33,461 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/7c224980df264abb93a6d50f2a977493, entries=118388, sequenceid=16931, filesize=2.3 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4433:2016-11-08 04:22:33,935 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~128.26 MB/134488768, currentsize=83.88 MB/87953664 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3475ms, sequenceid=16931, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4438:2016-11-08 04:22:34,898 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-3/hbase-root-regionserver-node-3.cluster.log:4446:2016-11-08 04:23:05,196 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into e6e3eede2e1546e488b4245c5f84bba3(size=47.8 M), total size for store is 799.3 M. This selection was in queue for 0sec, and took 1mins, 14sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4447:2016-11-08 04:23:05,196 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=48.2 M, priority=0, time=730895814340331; duration=1mins, 14sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4448:2016-11-08 04:23:05,199 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4449:2016-11-08 04:23:05,199 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=41.2 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4451:2016-11-08 04:23:07,140 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18705, memsize=152.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/71b06fe14a754b1d9cd741ed3d1ab967 ./node-3/hbase-root-regionserver-node-3.cluster.log:4452:2016-11-08 04:23:10,043 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 79bc33841b4743b1b63bf433dafbe69b(size=43.9 M), total size for store is 489.8 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:4453:2016-11-08 04:23:10,044 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=41.2 M, priority=0, time=730970600116955; duration=4sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4454:2016-11-08 04:23:10,046 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4455:2016-11-08 04:23:10,046 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.HStore: Starting compaction of 8 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=489.8 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4457:2016-11-08 04:23:11,650 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18705, memsize=283.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f957045e70124b74aae48b0184bbe30d ./node-3/hbase-root-regionserver-node-3.cluster.log:4459:2016-11-08 04:23:12,763 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18705, memsize=79.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/935cbdc004284c67972aba0b6eaa5295 ./node-3/hbase-root-regionserver-node-3.cluster.log:4460:2016-11-08 04:23:12,777 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/71b06fe14a754b1d9cd741ed3d1ab967, entries=475517, sequenceid=18705, filesize=12.3 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4461:2016-11-08 04:23:12,790 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/f957045e70124b74aae48b0184bbe30d, entries=1426551, sequenceid=18705, filesize=30.2 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4462:2016-11-08 04:23:12,804 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/935cbdc004284c67972aba0b6eaa5295, entries=475517, sequenceid=18705, filesize=9.6 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4463:2016-11-08 04:23:12,812 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~515.16 MB/540187312, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7217ms, sequenceid=18705, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4470:2016-11-08 04:23:20,776 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18825, memsize=41.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f1928a8a5d79422c8f62df928d61240d ./node-3/hbase-root-regionserver-node-3.cluster.log:4471:2016-11-08 04:23:21,093 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Splitting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4472:2016-11-08 04:23:21,156 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.SplitTransaction: Starting split of region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4473:2016-11-08 04:23:22,295 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18825, memsize=76.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ab66df267f27474ba1f32a244117757c ./node-3/hbase-root-regionserver-node-3.cluster.log:4475:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:4485:2016-11-08 04:23:22,697 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=8, fileSize=489.8 M (212.9 M, 56.4 M, 42.9 M, 14.4 M, 20.2 M, 41.1 M, 58.0 M, 43.9 M), priority=2, time=730975447583415; duration=12sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4486:2016-11-08 04:23:22,712 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=18825, memsize=21.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7da7c65846ca4d5097f5f9e9df939fe2 ./node-3/hbase-root-regionserver-node-3.cluster.log:4487:2016-11-08 04:23:22,725 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f1928a8a5d79422c8f62df928d61240d, entries=128365, sequenceid=18825, filesize=3.1 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4488:2016-11-08 04:23:22,742 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/ab66df267f27474ba1f32a244117757c, entries=385095, sequenceid=18825, filesize=7.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4489:2016-11-08 04:23:22,749 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/7da7c65846ca4d5097f5f9e9df939fe2, entries=128365, sequenceid=18825, filesize=2.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4490:2016-11-08 04:23:22,759 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~139.07 MB/145822640, currentsize=43.86 MB/45986416 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3275ms, sequenceid=18825, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4492:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:4502:2016-11-08 04:23:23,740 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4504:2016-11-08 04:23:23,740 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478578494835] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=104.7 M (36.0 M, 56.6 M, 12.1 M), priority=0, time=730912241018163; duration=1mins, 16sec ./node-3/hbase-root-regionserver-node-3.cluster.log:4505:2016-11-08 04:23:23,920 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.DefaultStoreFlusher: Flushed, sequenceid=19183, memsize=13.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4f9caa779f324d06ad279c5d9c38dcea ./node-3/hbase-root-regionserver-node-3.cluster.log:4506:2016-11-08 04:23:24,304 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.DefaultStoreFlusher: Flushed, sequenceid=19183, memsize=24.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7ec91e98f080464fa58e8bd17e5c5bbc ./node-3/hbase-root-regionserver-node-3.cluster.log:4507:2016-11-08 04:23:24,397 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.DefaultStoreFlusher: Flushed, sequenceid=19183, memsize=6.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/08241caa0a35450ca7ff92ae907b242c ./node-3/hbase-root-regionserver-node-3.cluster.log:4508:2016-11-08 04:23:24,421 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/4f9caa779f324d06ad279c5d9c38dcea, entries=40481, sequenceid=19183, filesize=1.0 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4509:2016-11-08 04:23:24,426 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/7ec91e98f080464fa58e8bd17e5c5bbc, entries=121443, sequenceid=19183, filesize=2.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:4510:2016-11-08 04:23:24,464 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/08241caa0a35450ca7ff92ae907b242c, entries=40481, sequenceid=19183, filesize=824.8 K ./node-3/hbase-root-regionserver-node-3.cluster.log:4511:2016-11-08 04:23:24,472 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HRegion: Finished memstore flush of ~43.86 MB/45986416, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 732ms, sequenceid=19183, compaction requested=true ./node-3/hbase-root-regionserver-node-3.cluster.log:4512:2016-11-08 04:23:24,475 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-3/hbase-root-regionserver-node-3.cluster.log:4513:2016-11-08 04:23:24,478 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:4514:2016-11-08 04:23:24,491 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:4515:2016-11-08 04:23:24,491 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-3/hbase-root-regionserver-node-3.cluster.log:4516:2016-11-08 04:23:24,491 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-3/hbase-root-regionserver-node-3.cluster.log:4517:2016-11-08 04:23:24,494 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:4518:2016-11-08 04:23:24,508 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:4519:2016-11-08 04:23:24,508 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.SplitTransaction: Preparing to split 35 storefiles for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. using 10 threads ./node-3/hbase-root-regionserver-node-3.cluster.log:4528:2016-11-08 04:23:26,155 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: 4f9caa779f324d06ad279c5d9c38dcea.393d2bfd8b1c52ce08540306659624f2_535855 cb:4f9caa779f324d06ad279c5d9c38dcea.393d2bfd8b1c52ce08540306659624f2_535855. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4529:2016-11-08 04:23:26,263 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: 8bb75bc7994b45f3a13084f8b202a6bc.393d2bfd8b1c52ce08540306659624f2_6343308 cb:8bb75bc7994b45f3a13084f8b202a6bc.393d2bfd8b1c52ce08540306659624f2_6343308. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4530:2016-11-08 04:23:26,366 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: e304e17e513742719abaa50fc439f45b.393d2bfd8b1c52ce08540306659624f2_47682557 cb:e304e17e513742719abaa50fc439f45b.393d2bfd8b1c52ce08540306659624f2_47682557. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4531:2016-11-08 04:23:26,369 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: e304e17e513742719abaa50fc439f45b.393d2bfd8b1c52ce08540306659624f2_24135128 cb:e304e17e513742719abaa50fc439f45b.393d2bfd8b1c52ce08540306659624f2_24135128. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4532:2016-11-08 04:23:26,394 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: e6e3eede2e1546e488b4245c5f84bba3.393d2bfd8b1c52ce08540306659624f2_47986893 cb:e6e3eede2e1546e488b4245c5f84bba3.393d2bfd8b1c52ce08540306659624f2_47986893. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4533:2016-11-08 04:23:26,397 WARN [StoreFileOpenerThread-big-1] hfile.LruBlockCache: Cached an already cached block: e6e3eede2e1546e488b4245c5f84bba3.393d2bfd8b1c52ce08540306659624f2_25036444 cb:e6e3eede2e1546e488b4245c5f84bba3.393d2bfd8b1c52ce08540306659624f2_25036444. This is harmless and can happen in rare cases (see HBASE-8547) ./node-3/hbase-root-regionserver-node-3.cluster.log:4548:2016-11-08 04:23:26,716 INFO [StoreFileOpenerThread-tiny-1] regionserver.StoreFile: Bloom filter turned off by CF config for 09f86ede1e8a4ed9a84115439b9cafde.393d2bfd8b1c52ce08540306659624f2 ./node-3/hbase-root-regionserver-node-3.cluster.log:4551:2016-11-08 04:23:26,775 INFO [StoreFileOpenerThread-tiny-1] regionserver.StoreFile: Bloom filter turned off by CF config for 09f86ede1e8a4ed9a84115439b9cafde.393d2bfd8b1c52ce08540306659624f2 ./node-3/hbase-root-regionserver-node-3.cluster.log:4562:2016-11-08 04:23:27,165 INFO [regionserver/node-3.cluster/192.168.124.4:16020-splits-1478579001099] regionserver.SplitRequest: Region split, hbase:meta updated, and report to master. Parent=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., new regions: IntegrationTestBigLinkedList,,1478579001155.d55ef81c2f8299abbddfce0445067830., IntegrationTestBigLinkedList,/\xFB\x14,1478579001155.08629d59564726da2497f70451aafcdb.. Split took 6sec ./node-3/hbase-root-regionserver-node-3.cluster.log:5385:2016-11-08 04:34:33,015 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.StoreFile: Bloom filter turned off by CF config for 09f86ede1e8a4ed9a84115439b9cafde.393d2bfd8b1c52ce08540306659624f2 ./node-3/hbase-root-regionserver-node-3.cluster.log:5471:2016-11-08 04:36:02,827 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478578391963] regionserver.StoreFile: Bloom filter turned off by CF config for 09f86ede1e8a4ed9a84115439b9cafde.393d2bfd8b1c52ce08540306659624f2 ./node-3/hbase-root-regionserver-node-3.cluster.log:8320:2016-11-08 04:59:47,663 INFO [PriorityRpcServer.handler=4,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8321:2016-11-08 04:59:47,679 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8322:2016-11-08 04:59:47,679 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8324:2016-11-08 04:59:47,848 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8325:2016-11-08 04:59:47,848 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8338:2016-11-08 04:59:47,990 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8339:2016-11-08 04:59:47,991 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8340:2016-11-08 04:59:47,992 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8341:2016-11-08 04:59:47,992 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8352:2016-11-08 04:59:48,174 INFO [RS_OPEN_REGION-node-3:16020-1] regionserver.HRegionFileSystem: Cleaned up old failed split transaction detritus: hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.splits ./node-3/hbase-root-regionserver-node-3.cluster.log:8353:2016-11-08 04:59:48,178 INFO [RS_OPEN_REGION-node-3:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19187 ./node-3/hbase-root-regionserver-node-3.cluster.log:8354:2016-11-08 04:59:48,181 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8355:2016-11-08 04:59:48,188 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478580753290 ./node-3/hbase-root-regionserver-node-3.cluster.log:8356:2016-11-08 04:59:48,194 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8357:2016-11-08 04:59:48,194 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8358:2016-11-08 04:59:48,194 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Starting compaction of 4 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=47.7 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8359:2016-11-08 04:59:48,194 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=19.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8367:2016-11-08 04:59:49,806 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Completed compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 33099dd2246b4664a710745e800972f5(size=21.2 M), total size for store is 817.5 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8368:2016-11-08 04:59:49,807 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=4, fileSize=19.5 M, priority=-2, time=733173594948256; duration=1sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8369:2016-11-08 04:59:49,811 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8370:2016-11-08 04:59:49,811 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=12.9 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8375:2016-11-08 04:59:51,138 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1fa26d9e384f4571a8d5e74896023d4f(size=18.7 M), total size for store is 508.5 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8376:2016-11-08 04:59:51,138 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=12.9 M, priority=-1, time=733175212496109; duration=1sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8379:2016-11-08 04:59:53,099 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Completed compaction of 4 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 95963938a3d94df7b89be1889088f275(size=41.8 M), total size for store is 1.2 G. This selection was in queue for 0sec, and took 4sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8380:2016-11-08 04:59:53,099 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=4, fileSize=47.7 M, priority=-2, time=733173594950313; duration=4sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8400:2016-11-08 05:00:38,106 INFO [PriorityRpcServer.handler=13,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:8401:2016-11-08 05:00:38,114 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:8402:2016-11-08 05:00:38,117 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:8403:2016-11-08 05:00:38,117 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-3/hbase-root-regionserver-node-3.cluster.log:8404:2016-11-08 05:00:38,118 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:8405:2016-11-08 05:00:38,129 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8406:2016-11-08 05:00:38,135 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8407:2016-11-08 05:00:38,146 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8408:2016-11-08 05:00:38,146 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8409:2016-11-08 05:00:38,199 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8410:2016-11-08 05:00:38,199 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8419:2016-11-08 05:00:38,260 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8420:2016-11-08 05:00:38,260 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8428:2016-11-08 05:00:38,352 INFO [RS_OPEN_REGION-node-3:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19195 ./node-3/hbase-root-regionserver-node-3.cluster.log:8429:2016-11-08 05:00:38,357 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8430:2016-11-08 05:00:38,370 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8431:2016-11-08 05:00:38,370 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Starting compaction of 9 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=817.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8432:2016-11-08 05:00:38,371 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8433:2016-11-08 05:00:38,372 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=1.2 G ./node-3/hbase-root-regionserver-node-3.cluster.log:8434:2016-11-08 05:00:38,375 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478580753290 ./node-3/hbase-root-regionserver-node-3.cluster.log:8450:2016-11-08 05:01:17,239 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Flushing IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8451:2016-11-08 05:02:03,886 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Completed compaction of 9 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into c535582438c841b0a2d7d52fb8659f1c(size=616.5 M), total size for store is 616.5 M. This selection was in queue for 0sec, and took 1mins, 25sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8452:2016-11-08 05:02:03,886 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=9, fileSize=817.5 M, priority=2, time=733223770991776; duration=1mins, 25sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8453:2016-11-08 05:02:03,889 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8454:2016-11-08 05:02:03,889 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Starting compaction of 9 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=508.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8463:2016-11-08 05:02:07,332 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:8465:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:8475:2016-11-08 05:02:07,467 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=1.2 G (90.2 M, 204.4 M, 144.5 M, 113.4 M, 152.4 M, 353.8 M, 88.9 M, 30.0 M, 41.8 M), priority=2, time=733223772824441; duration=1mins, 29sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8477:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:8487:2016-11-08 05:02:07,476 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=508.5 M (212.9 M, 56.4 M, 42.9 M, 14.4 M, 20.2 M, 41.1 M, 58.0 M, 43.9 M, 18.7 M), priority=2, time=733309290142723; duration=3sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8488:2016-11-08 05:02:07,476 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:8489:2016-11-08 05:02:07,481 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:8490:2016-11-08 05:02:07,483 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:8491:2016-11-08 05:02:07,491 INFO [RS_CLOSE_REGION-node-3:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8492:2016-11-08 05:02:07,495 INFO [PriorityRpcServer.handler=0,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8493:2016-11-08 05:02:07,500 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8494:2016-11-08 05:02:07,501 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8495:2016-11-08 05:02:07,506 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8496:2016-11-08 05:02:07,507 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8505:2016-11-08 05:02:07,538 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8506:2016-11-08 05:02:07,538 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8514:2016-11-08 05:02:07,576 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19200 ./node-3/hbase-root-regionserver-node-3.cluster.log:8515:2016-11-08 05:02:07,577 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8516:2016-11-08 05:02:07,581 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8517:2016-11-08 05:02:07,581 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8518:2016-11-08 05:02:07,581 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 9 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=508.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8519:2016-11-08 05:02:07,581 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=1.2 G ./node-3/hbase-root-regionserver-node-3.cluster.log:8520:2016-11-08 05:02:07,582 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478580753290 ./node-3/hbase-root-regionserver-node-3.cluster.log:8536:2016-11-08 05:02:08,206 INFO [PriorityRpcServer.handler=3,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:8538:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:8548:2016-11-08 05:02:08,242 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=508.5 M (212.9 M, 56.4 M, 42.9 M, 14.4 M, 20.2 M, 41.1 M, 58.0 M, 43.9 M, 18.7 M), priority=2, time=733312982351997; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8550:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:8560:2016-11-08 05:02:08,449 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:8561:2016-11-08 05:02:08,449 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=1.2 G (90.2 M, 204.4 M, 144.5 M, 113.4 M, 152.4 M, 353.8 M, 88.9 M, 30.0 M, 41.8 M), priority=2, time=733312982458141; duration=0sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8562:2016-11-08 05:02:08,455 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:8563:2016-11-08 05:02:08,460 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:8564:2016-11-08 05:02:08,466 INFO [RS_CLOSE_REGION-node-3:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8565:2016-11-08 05:02:08,470 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8566:2016-11-08 05:02:08,476 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8567:2016-11-08 05:02:08,477 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8569:2016-11-08 05:02:08,481 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8570:2016-11-08 05:02:08,482 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8572:2016-11-08 05:02:08,508 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8573:2016-11-08 05:02:08,509 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8576:2016-11-08 05:02:08,541 INFO [RS_OPEN_REGION-node-3:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19203 ./node-3/hbase-root-regionserver-node-3.cluster.log:8577:2016-11-08 05:02:08,543 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8578:2016-11-08 05:02:08,545 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8579:2016-11-08 05:02:08,545 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8580:2016-11-08 05:02:08,546 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=1.2 G ./node-3/hbase-root-regionserver-node-3.cluster.log:8581:2016-11-08 05:02:08,546 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Starting compaction of 9 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=508.5 M ./node-3/hbase-root-regionserver-node-3.cluster.log:8582:2016-11-08 05:02:08,547 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478580753290 ./node-3/hbase-root-regionserver-node-3.cluster.log:8597:2016-11-08 05:02:59,031 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.HStore: Completed compaction of 9 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into b0b677af52354c2591ed4fa0bab47029(size=672.6 M), total size for store is 672.6 M. This selection was in queue for 0sec, and took 50sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8598:2016-11-08 05:02:59,031 INFO [regionserver/node-3.cluster/192.168.124.4:16020-longCompactions-1478580754290] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=508.5 M, priority=2, time=733313946809674; duration=50sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8599:2016-11-08 05:03:17,230 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Flushing IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8600:2016-11-08 05:03:37,861 INFO [PriorityRpcServer.handler=19,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:8602:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-3/hbase-root-regionserver-node-3.cluster.log:8612:2016-11-08 05:03:38,099 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:8613:2016-11-08 05:03:38,099 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=1.2 G (90.2 M, 204.4 M, 144.5 M, 113.4 M, 152.4 M, 353.8 M, 88.9 M, 30.0 M, 41.8 M), priority=2, time=733313946771610; duration=1mins, 29sec ./node-3/hbase-root-regionserver-node-3.cluster.log:8614:2016-11-08 05:03:38,104 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:8615:2016-11-08 05:03:38,106 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:8616:2016-11-08 05:03:38,113 INFO [RS_CLOSE_REGION-node-3:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8617:2016-11-08 05:03:38,117 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8618:2016-11-08 05:03:38,122 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8619:2016-11-08 05:03:38,122 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8621:2016-11-08 05:03:38,127 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8622:2016-11-08 05:03:38,127 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8624:2016-11-08 05:03:38,183 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:8625:2016-11-08 05:03:38,183 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:8626:2016-11-08 05:03:38,193 INFO [RS_OPEN_REGION-node-3:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19208 ./node-3/hbase-root-regionserver-node-3.cluster.log:8627:2016-11-08 05:03:38,195 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8628:2016-11-08 05:03:38,198 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:8629:2016-11-08 05:03:38,198 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=1.2 G ./node-3/hbase-root-regionserver-node-3.cluster.log:8630:2016-11-08 05:03:38,199 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478580753290 ./node-3/hbase-root-regionserver-node-3.cluster.log:8643:2016-11-08 05:05:20,355 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.HStore: Completed compaction of 9 (all) file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 70eba58e977d462697ae5bc5a2e7a02f(size=1.2 G), total size for store is 1.2 G. This selection was in queue for 0sec, and took 1mins, 42sec to execute. ./node-3/hbase-root-regionserver-node-3.cluster.log:8644:2016-11-08 05:05:20,355 INFO [regionserver/node-3.cluster/192.168.124.4:16020-shortCompactions-1478581188182] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=1.2 G, priority=2, time=733403599240473; duration=1mins, 42sec ./node-3/hbase-root-regionserver-node-3.cluster.log:9443:2016-11-08 05:19:17,252 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9444:2016-11-08 05:19:17,258 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9445:2016-11-08 05:19:17,259 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9447:2016-11-08 05:19:17,263 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9448:2016-11-08 05:19:17,263 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9449:2016-11-08 05:19:17,268 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9450:2016-11-08 05:19:17,268 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9451:2016-11-08 05:19:17,278 INFO [RS_OPEN_REGION-node-3:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19238 ./node-3/hbase-root-regionserver-node-3.cluster.log:9452:2016-11-08 05:19:17,280 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9453:2016-11-08 05:19:17,283 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478582098693 ./node-3/hbase-root-regionserver-node-3.cluster.log:9459:2016-11-08 05:19:37,605 INFO [PriorityRpcServer.handler=12,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:9460:2016-11-08 05:19:37,607 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:9461:2016-11-08 05:19:37,608 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:9462:2016-11-08 05:19:37,608 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:9463:2016-11-08 05:19:37,620 INFO [RS_CLOSE_REGION-node-3:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9464:2016-11-08 05:19:37,623 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9465:2016-11-08 05:19:37,632 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9466:2016-11-08 05:19:37,632 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9468:2016-11-08 05:19:37,637 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9469:2016-11-08 05:19:37,637 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9470:2016-11-08 05:19:37,642 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9471:2016-11-08 05:19:37,642 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9472:2016-11-08 05:19:37,653 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19241 ./node-3/hbase-root-regionserver-node-3.cluster.log:9473:2016-11-08 05:19:37,655 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9474:2016-11-08 05:19:37,658 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478582098693 ./node-3/hbase-root-regionserver-node-3.cluster.log:9537:2016-11-08 05:20:08,180 INFO [PriorityRpcServer.handler=19,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-3/hbase-root-regionserver-node-3.cluster.log:9538:2016-11-08 05:20:08,182 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-3/hbase-root-regionserver-node-3.cluster.log:9539:2016-11-08 05:20:08,182 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-3/hbase-root-regionserver-node-3.cluster.log:9540:2016-11-08 05:20:08,182 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-3/hbase-root-regionserver-node-3.cluster.log:9541:2016-11-08 05:20:08,193 INFO [RS_CLOSE_REGION-node-3:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9542:2016-11-08 05:20:08,199 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9543:2016-11-08 05:20:08,206 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9544:2016-11-08 05:20:08,206 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9546:2016-11-08 05:20:08,212 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9547:2016-11-08 05:20:08,212 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9549:2016-11-08 05:20:08,219 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-3/hbase-root-regionserver-node-3.cluster.log:9550:2016-11-08 05:20:08,220 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-3/hbase-root-regionserver-node-3.cluster.log:9551:2016-11-08 05:20:08,231 INFO [RS_OPEN_REGION-node-3:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19244 ./node-3/hbase-root-regionserver-node-3.cluster.log:9552:2016-11-08 05:20:08,233 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-3/hbase-root-regionserver-node-3.cluster.log:9553:2016-11-08 05:20:08,237 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-3.cluster,16020,1478582098693 ./node-4/hbase-root-regionserver-node-4.cluster.log:10000:2016-11-08 05:12:38,137 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:10001:2016-11-08 05:12:38,151 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:10002:2016-11-08 05:12:38,155 INFO [PriorityRpcServer.handler=17,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:10003:2016-11-08 05:12:38,164 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=14, currentSize=15010840, freeSize=12823701480, maxSize=12838712320, heapSize=15010840, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:10004:2016-11-08 05:12:38,165 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:10006:2016-11-08 05:12:38,171 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=14, currentSize=15010840, freeSize=12823701480, maxSize=12838712320, heapSize=15010840, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:10007:2016-11-08 05:12:38,171 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:10008:2016-11-08 05:12:38,178 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=14, currentSize=15010840, freeSize=12823701480, maxSize=12838712320, heapSize=15010840, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:10009:2016-11-08 05:12:38,178 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:10010:2016-11-08 05:12:38,191 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19223 ./node-4/hbase-root-regionserver-node-4.cluster.log:10011:2016-11-08 05:12:38,193 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:10012:2016-11-08 05:12:38,197 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478581638184 ./node-4/hbase-root-regionserver-node-4.cluster.log:1896:2016-11-08 03:52:12,948 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001207.temp to hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001298 ./node-4/hbase-root-regionserver-node-4.cluster.log:1904:2016-11-08 03:52:15,983 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001299.temp to hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001639 ./node-4/hbase-root-regionserver-node-4.cluster.log:1908:2016-11-08 03:52:16,201 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1909:2016-11-08 03:52:16,209 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for TbWaF: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:1910:2016-11-08 03:52:16,209 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:1911:2016-11-08 03:52:16,210 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:1912:2016-11-08 03:52:16,210 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:1913:2016-11-08 03:52:16,271 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:1914:2016-11-08 03:52:16,271 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:1915:2016-11-08 03:52:16,421 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nIFir: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:1916:2016-11-08 03:52:16,421 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:1917:2016-11-08 03:52:16,423 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:1918:2016-11-08 03:52:16,423 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:1919:2016-11-08 03:52:16,627 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Replaying edits from hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001298 ./node-4/hbase-root-regionserver-node-4.cluster.log:1920:2016-11-08 03:52:18,209 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Replaying edits from hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000001639 ./node-4/hbase-root-regionserver-node-4.cluster.log:1922:2016-11-08 03:52:20,719 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1618, memsize=29.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1103edc93e30464fa919ef9948d5df26 ./node-4/hbase-root-regionserver-node-4.cluster.log:1923:2016-11-08 03:52:21,202 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1618, memsize=52.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/767baa8b7c9b45d9abb6f9a7a75392e8 ./node-4/hbase-root-regionserver-node-4.cluster.log:1926:2016-11-08 03:52:21,519 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1618, memsize=47.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e4e1aa39a81a4a67b37fc7aca419f5ff ./node-4/hbase-root-regionserver-node-4.cluster.log:1927:2016-11-08 03:52:21,546 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/1103edc93e30464fa919ef9948d5df26, entries=90712, sequenceid=1618, filesize=2.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1928:2016-11-08 03:52:21,552 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/767baa8b7c9b45d9abb6f9a7a75392e8, entries=272136, sequenceid=1618, filesize=3.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1929:2016-11-08 03:52:21,558 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e4e1aa39a81a4a67b37fc7aca419f5ff, entries=285476, sequenceid=1618, filesize=7.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1930:2016-11-08 03:52:21,558 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Finished memstore flush of ~129.58 MB/135875904, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 1091ms, sequenceid=1618, compaction requested=true; wal=null ./node-4/hbase-root-regionserver-node-4.cluster.log:1935:2016-11-08 03:52:22,427 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1639, memsize=12.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/751c14f5e1cb426b9752eb8070875afe ./node-4/hbase-root-regionserver-node-4.cluster.log:1936:2016-11-08 03:52:22,694 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1639, memsize=22.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8454c93fc0d04146849bcac29babe9cb ./node-4/hbase-root-regionserver-node-4.cluster.log:1937:2016-11-08 03:52:22,741 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1639, memsize=6.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6dc099bd47644f31a8171851d0e2cecc ./node-4/hbase-root-regionserver-node-4.cluster.log:1938:2016-11-08 03:52:22,749 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/751c14f5e1cb426b9752eb8070875afe, entries=39234, sequenceid=1639, filesize=996.1 K ./node-4/hbase-root-regionserver-node-4.cluster.log:1939:2016-11-08 03:52:22,755 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/8454c93fc0d04146849bcac29babe9cb, entries=117702, sequenceid=1639, filesize=1.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1940:2016-11-08 03:52:22,765 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/6dc099bd47644f31a8171851d0e2cecc, entries=39234, sequenceid=1639, filesize=1.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1941:2016-11-08 03:52:22,765 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Finished memstore flush of ~41.91 MB/43942080, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 430ms, sequenceid=1639, compaction requested=true; wal=null ./node-4/hbase-root-regionserver-node-4.cluster.log:1942:2016-11-08 03:52:22,779 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=1640 ./node-4/hbase-root-regionserver-node-4.cluster.log:1943:2016-11-08 03:52:22,799 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1944:2016-11-08 03:52:22,811 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:1945:2016-11-08 03:52:22,811 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1946:2016-11-08 03:52:22,812 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 7 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=75.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1947:2016-11-08 03:52:22,812 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1948:2016-11-08 03:52:22,812 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=90.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1968:2016-11-08 03:52:29,405 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 7 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 465a25d4daa84bf780599456c1abaf3b(size=91.3 M), total size for store is 91.3 M. This selection was in queue for 0sec, and took 6sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:1969:2016-11-08 03:52:29,405 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=7, fileSize=75.5 M, priority=3, time=729128212741871; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:1970:2016-11-08 03:52:29,407 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1971:2016-11-08 03:52:29,407 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 6 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=51.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:1972:2016-11-08 03:52:34,252 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 6 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ad07aa13ca5b4d108980c691b4f50dbd(size=48.0 M), total size for store is 48.0 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:1973:2016-11-08 03:52:34,252 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=6, fileSize=51.4 M, priority=4, time=729134808314686; duration=4sec ./node-4/hbase-root-regionserver-node-4.cluster.log:1986:2016-11-08 03:52:40,271 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:1991:2016-11-08 03:52:40,699 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1711, memsize=42.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f69bd7443dd749d5b509ef063356e7b2 ./node-4/hbase-root-regionserver-node-4.cluster.log:1996:2016-11-08 03:52:43,371 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1711, memsize=75.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/84ba853683044caaa56390144f03ea05 ./node-4/hbase-root-regionserver-node-4.cluster.log:2001:2016-11-08 03:52:43,923 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1711, memsize=22.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f864e82777aa4b0a8bc6393e9443ede1 ./node-4/hbase-root-regionserver-node-4.cluster.log:2002:2016-11-08 03:52:43,990 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f69bd7443dd749d5b509ef063356e7b2, entries=130974, sequenceid=1711, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2005:2016-11-08 03:52:44,348 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/84ba853683044caaa56390144f03ea05, entries=392922, sequenceid=1711, filesize=5.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2006:2016-11-08 03:52:44,407 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/f864e82777aa4b0a8bc6393e9443ede1, entries=130974, sequenceid=1711, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2007:2016-11-08 03:52:44,443 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~139.90 MB/146690880, currentsize=144.23 MB/151234720 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5780ms, sequenceid=1711, compaction requested=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2010:2016-11-08 03:52:46,003 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1795, memsize=46.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0f48b97a92d64494b9eb272f534a5124 ./node-4/hbase-root-regionserver-node-4.cluster.log:2014:2016-11-08 03:52:47,619 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 9 (all) file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ebee99471b0c41148ccc82d6b74f2695(size=90.2 M), total size for store is 95.2 M. This selection was in queue for 0sec, and took 24sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2015:2016-11-08 03:52:47,619 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=90.9 M, priority=2, time=729128213165829; duration=24sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2017:2016-11-08 03:52:48,794 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1795, memsize=83.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0747c1b403e94050a4f43b911e570541 ./node-4/hbase-root-regionserver-node-4.cluster.log:2018:2016-11-08 03:52:49,521 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1795, memsize=24.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8cad1c09b6af485e97918854bc30bee9 ./node-4/hbase-root-regionserver-node-4.cluster.log:2019:2016-11-08 03:52:49,562 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/0f48b97a92d64494b9eb272f534a5124, entries=143577, sequenceid=1795, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2021:2016-11-08 03:52:49,628 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/0747c1b403e94050a4f43b911e570541, entries=430731, sequenceid=1795, filesize=5.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2022:2016-11-08 03:52:49,663 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8cad1c09b6af485e97918854bc30bee9, entries=143577, sequenceid=1795, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2023:2016-11-08 03:52:49,765 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~153.36 MB/160806240, currentsize=144.73 MB/151760000 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5250ms, sequenceid=1795, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2024:2016-11-08 03:52:49,779 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2025:2016-11-08 03:52:49,779 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=98.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2029:2016-11-08 03:52:49,829 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2030:2016-11-08 03:52:49,829 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=55.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2035:2016-11-08 03:52:51,687 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1880, memsize=45.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6536e4bb81cd46e0a12cc253da2d5d1b ./node-4/hbase-root-regionserver-node-4.cluster.log:2049:2016-11-08 03:52:54,047 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1880, memsize=81.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1b1f341329e34e5da337c27bf374f452 ./node-4/hbase-root-regionserver-node-4.cluster.log:2053:2016-11-08 03:52:55,211 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1880, memsize=23.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1bb4e6507e624baebaed448521d294f6 ./node-4/hbase-root-regionserver-node-4.cluster.log:2054:2016-11-08 03:52:55,259 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/6536e4bb81cd46e0a12cc253da2d5d1b, entries=140470, sequenceid=1880, filesize=3.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2055:2016-11-08 03:52:55,284 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/1b1f341329e34e5da337c27bf374f452, entries=421410, sequenceid=1880, filesize=5.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2056:2016-11-08 03:52:55,329 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/1bb4e6507e624baebaed448521d294f6, entries=140470, sequenceid=1880, filesize=3.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2058:2016-11-08 03:52:55,548 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~150.04 MB/157326400, currentsize=140.41 MB/147229600 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5768ms, sequenceid=1880, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2060:2016-11-08 03:52:57,491 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1969, memsize=44.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9bea31b5fcad468983a2c71f57782cc1 ./node-4/hbase-root-regionserver-node-4.cluster.log:2071:2016-11-08 03:53:00,139 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1969, memsize=81.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/925ae6d6f7a448f0b9a5d40dc8c2c1ff ./node-4/hbase-root-regionserver-node-4.cluster.log:2072:2016-11-08 03:53:00,522 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1969, memsize=23.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4730500707294f33b076e8350828b260 ./node-4/hbase-root-regionserver-node-4.cluster.log:2073:2016-11-08 03:53:00,534 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/9bea31b5fcad468983a2c71f57782cc1, entries=139638, sequenceid=1969, filesize=3.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2074:2016-11-08 03:53:00,545 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/925ae6d6f7a448f0b9a5d40dc8c2c1ff, entries=418914, sequenceid=1969, filesize=5.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2075:2016-11-08 03:53:00,588 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/4730500707294f33b076e8350828b260, entries=139638, sequenceid=1969, filesize=3.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2076:2016-11-08 03:53:00,916 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~149.15 MB/156394560, currentsize=114.35 MB/119904960 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5297ms, sequenceid=1969, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2078:2016-11-08 03:53:02,148 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2048, memsize=39.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/273dc933130e48a6bed578ba2e4d9b6c ./node-4/hbase-root-regionserver-node-4.cluster.log:2081:2016-11-08 03:53:04,735 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2048, memsize=70.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7566cd8c26514c3cb2ab2267a6ab0ed7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2082:2016-11-08 03:53:05,186 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2048, memsize=20.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/68f678556b98466d855726606752295a ./node-4/hbase-root-regionserver-node-4.cluster.log:2083:2016-11-08 03:53:05,208 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/273dc933130e48a6bed578ba2e4d9b6c, entries=121759, sequenceid=2048, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2084:2016-11-08 03:53:05,260 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/7566cd8c26514c3cb2ab2267a6ab0ed7, entries=365277, sequenceid=2048, filesize=4.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2085:2016-11-08 03:53:05,304 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/68f678556b98466d855726606752295a, entries=121759, sequenceid=2048, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2086:2016-11-08 03:53:05,381 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~130.05 MB/136370080, currentsize=128.84 MB/135098880 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4264ms, sequenceid=2048, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2092:2016-11-08 03:53:06,865 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2130, memsize=40.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/642b7ba69c074a9ea6e41ec83a110c30 ./node-4/hbase-root-regionserver-node-4.cluster.log:2101:2016-11-08 03:53:09,524 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2130, memsize=73.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/eb805e8adb8b434581fd36212f68e897 ./node-4/hbase-root-regionserver-node-4.cluster.log:2103:2016-11-08 03:53:10,491 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2130, memsize=21.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/03d52226744441c5a19abeb204f51cd1 ./node-4/hbase-root-regionserver-node-4.cluster.log:2104:2016-11-08 03:53:10,576 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/642b7ba69c074a9ea6e41ec83a110c30, entries=127154, sequenceid=2130, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2105:2016-11-08 03:53:10,589 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into a3e83fa95ff441a9aafe61ccd9de966b(size=53.8 M), total size for store is 64.0 M. This selection was in queue for 0sec, and took 20sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2106:2016-11-08 03:53:10,590 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=55.0 M, priority=7, time=729155229980132; duration=20sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2107:2016-11-08 03:53:10,604 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/eb805e8adb8b434581fd36212f68e897, entries=381462, sequenceid=2130, filesize=5.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2108:2016-11-08 03:53:10,605 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2109:2016-11-08 03:53:10,605 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=13.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2110:2016-11-08 03:53:10,645 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/03d52226744441c5a19abeb204f51cd1, entries=127154, sequenceid=2130, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2112:2016-11-08 03:53:10,898 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~135.82 MB/142412480, currentsize=140.68 MB/147509600 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5254ms, sequenceid=2130, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2119:2016-11-08 03:53:12,723 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2222, memsize=45.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8007edfebf8241f0b5ffa9247bf96f83 ./node-4/hbase-root-regionserver-node-4.cluster.log:2125:2016-11-08 03:53:13,553 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2418272b4f094d51bd4a0c06ec73103f(size=102.0 M), total size for store is 115.4 M. This selection was in queue for 0sec, and took 23sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2126:2016-11-08 03:53:13,553 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=98.3 M, priority=7, time=729155180233657; duration=23sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2127:2016-11-08 03:53:13,559 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2128:2016-11-08 03:53:13,559 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 7 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=121.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2129:2016-11-08 03:53:15,417 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2222, memsize=82.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/108209d1984c499080abe4dedfdb922a ./node-4/hbase-root-regionserver-node-4.cluster.log:2130:2016-11-08 03:53:15,519 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into dbe1ddb6abfd41c5b9e071e6071126ea(size=19.7 M), total size for store is 121.7 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2131:2016-11-08 03:53:15,519 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=4, fileSize=13.4 M, priority=3, time=729176006039474; duration=4sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2132:2016-11-08 03:53:15,528 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2133:2016-11-08 03:53:15,528 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 5 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=67.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2134:2016-11-08 03:53:16,176 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2222, memsize=23.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c4aa908d8ccd48428349ba0d6f1ad647 ./node-4/hbase-root-regionserver-node-4.cluster.log:2135:2016-11-08 03:53:16,215 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/8007edfebf8241f0b5ffa9247bf96f83, entries=141373, sequenceid=2222, filesize=3.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2136:2016-11-08 03:53:16,230 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/108209d1984c499080abe4dedfdb922a, entries=424119, sequenceid=2222, filesize=5.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2137:2016-11-08 03:53:16,253 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/c4aa908d8ccd48428349ba0d6f1ad647, entries=141373, sequenceid=2222, filesize=3.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2138:2016-11-08 03:53:16,283 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~151.00 MB/158337760, currentsize=160.36 MB/168154560 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5288ms, sequenceid=2222, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2141:2016-11-08 03:53:17,619 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2324, memsize=50.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5d093fed9a284417a24ff06413019bcc ./node-4/hbase-root-regionserver-node-4.cluster.log:2151:2016-11-08 03:53:20,616 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2324, memsize=90.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f439b3cfb21446b3aec3ae55d7679ad8 ./node-4/hbase-root-regionserver-node-4.cluster.log:2157:2016-11-08 03:53:21,207 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2324, memsize=26.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e322b75734d94bb88eeda263153b32e4 ./node-4/hbase-root-regionserver-node-4.cluster.log:2158:2016-11-08 03:53:21,252 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5d093fed9a284417a24ff06413019bcc, entries=156628, sequenceid=2324, filesize=4.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2159:2016-11-08 03:53:21,282 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/f439b3cfb21446b3aec3ae55d7679ad8, entries=469884, sequenceid=2324, filesize=6.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2160:2016-11-08 03:53:21,444 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e322b75734d94bb88eeda263153b32e4, entries=156628, sequenceid=2324, filesize=3.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2161:2016-11-08 03:53:21,502 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~167.30 MB/175423360, currentsize=148.07 MB/155266720 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5198ms, sequenceid=2324, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2166:2016-11-08 03:53:22,477 INFO [PriorityRpcServer.handler=3,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:2168:2016-11-08 03:53:22,863 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2419, memsize=47.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5985cfe3140c4eaf9aadbfaab7ca62e0 ./node-4/hbase-root-regionserver-node-4.cluster.log:2170:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:2180:2016-11-08 03:53:23,685 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=7, fileSize=121.7 M (90.2 M, 5.0 M, 5.8 M, 5.5 M, 5.5 M, 4.7 M, 5.0 M), priority=3, time=729178960356070; duration=10sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2185:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:2195:2016-11-08 03:53:23,824 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=5, fileSize=67.2 M (53.8 M, 3.6 M, 3.5 M, 3.1 M, 3.2 M), priority=5, time=729180929111096; duration=8sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2205:2016-11-08 03:53:24,952 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2419, memsize=85.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/285a4e95010d45e2b175aec175fb17a2 ./node-4/hbase-root-regionserver-node-4.cluster.log:2206:2016-11-08 03:53:25,440 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2419, memsize=24.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/659bc6d3d1214d78b0284e857e14b06e ./node-4/hbase-root-regionserver-node-4.cluster.log:2207:2016-11-08 03:53:25,459 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5985cfe3140c4eaf9aadbfaab7ca62e0, entries=146781, sequenceid=2419, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2208:2016-11-08 03:53:25,476 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/285a4e95010d45e2b175aec175fb17a2, entries=440343, sequenceid=2419, filesize=5.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2209:2016-11-08 03:53:25,538 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/659bc6d3d1214d78b0284e857e14b06e, entries=146781, sequenceid=2419, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2210:2016-11-08 03:53:25,543 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~156.78 MB/164394720, currentsize=120.71 MB/126568784 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4012ms, sequenceid=2419, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2211:2016-11-08 03:53:25,543 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2213:2016-11-08 03:53:26,304 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2499, memsize=36.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/23904137d9f34a209629585494c37ebc ./node-4/hbase-root-regionserver-node-4.cluster.log:2214:2016-11-08 03:53:27,677 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2499, memsize=66.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e9c9bce53bda4a9697ca7276e01e07fd ./node-4/hbase-root-regionserver-node-4.cluster.log:2215:2016-11-08 03:53:28,008 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2499, memsize=19.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/608206108b84402fb634b62e3bb5dd90 ./node-4/hbase-root-regionserver-node-4.cluster.log:2216:2016-11-08 03:53:28,037 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/23904137d9f34a209629585494c37ebc, entries=113550, sequenceid=2499, filesize=2.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2217:2016-11-08 03:53:28,101 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/e9c9bce53bda4a9697ca7276e01e07fd, entries=340650, sequenceid=2499, filesize=4.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2218:2016-11-08 03:53:28,156 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/608206108b84402fb634b62e3bb5dd90, entries=113550, sequenceid=2499, filesize=2.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2219:2016-11-08 03:53:28,170 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~121.48 MB/127377424, currentsize=44.09 MB/46230896 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2627ms, sequenceid=2499, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2221:2016-11-08 03:53:28,597 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2673, memsize=14.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/bdec99fda1f44c1bb95e873453e10bc5 ./node-4/hbase-root-regionserver-node-4.cluster.log:2222:2016-11-08 03:53:29,020 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2673, memsize=25.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2ad436a52992460388c108c40845adb9 ./node-4/hbase-root-regionserver-node-4.cluster.log:2227:2016-11-08 03:53:29,171 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2673, memsize=7.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2096d5e41d3540b09b3e6714e5292683 ./node-4/hbase-root-regionserver-node-4.cluster.log:2228:2016-11-08 03:53:29,304 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/bdec99fda1f44c1bb95e873453e10bc5, entries=43835, sequenceid=2673, filesize=1.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2229:2016-11-08 03:53:29,326 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/2ad436a52992460388c108c40845adb9, entries=131505, sequenceid=2673, filesize=1.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2230:2016-11-08 03:53:29,335 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/2096d5e41d3540b09b3e6714e5292683, entries=43835, sequenceid=2673, filesize=1.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2231:2016-11-08 03:53:29,336 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~47.00 MB/49286352, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 1066ms, sequenceid=2673, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2232:2016-11-08 03:53:29,336 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed TbWaF ./node-4/hbase-root-regionserver-node-4.cluster.log:2233:2016-11-08 03:53:29,371 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:2234:2016-11-08 03:53:29,443 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:2235:2016-11-08 03:53:29,443 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nIFir ./node-4/hbase-root-regionserver-node-4.cluster.log:2236:2016-11-08 03:53:29,490 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:2237:2016-11-08 03:53:29,535 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2238:2016-11-08 03:53:29,543 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2239:2016-11-08 03:53:29,587 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for TbWaF: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2240:2016-11-08 03:53:29,587 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2241:2016-11-08 03:53:29,599 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2242:2016-11-08 03:53:29,599 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2243:2016-11-08 03:53:29,715 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2244:2016-11-08 03:53:29,716 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2245:2016-11-08 03:53:29,903 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2246:2016-11-08 03:53:29,903 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2247:2016-11-08 03:53:30,101 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=2677 ./node-4/hbase-root-regionserver-node-4.cluster.log:2248:2016-11-08 03:53:30,124 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2251:2016-11-08 03:53:30,196 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2252:2016-11-08 03:53:30,196 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=12.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2253:2016-11-08 03:53:30,207 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:2269:2016-11-08 03:53:30,648 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2270:2016-11-08 03:53:30,649 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=7.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2279:2016-11-08 03:53:32,445 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 23716343414645f7a643246d8a2b92fe(size=5.7 M), total size for store is 80.5 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2280:2016-11-08 03:53:32,446 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=7.7 M, priority=0, time=729196049721034; duration=1sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2281:2016-11-08 03:53:32,451 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2282:2016-11-08 03:53:32,451 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 6 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=34.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2331:2016-11-08 03:53:36,076 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into a580acacdc4245eea7c7e8310207d524(size=10.4 M), total size for store is 143.9 M. This selection was in queue for 0sec, and took 5sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2332:2016-11-08 03:53:36,076 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=12.5 M, priority=-2, time=729195597333148; duration=5sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2333:2016-11-08 03:53:36,079 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2334:2016-11-08 03:53:36,079 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=15.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2367:2016-11-08 03:53:39,507 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2765, memsize=40.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f3fd1cbd951447439482592925e99a36 ./node-4/hbase-root-regionserver-node-4.cluster.log:2381:2016-11-08 03:53:41,112 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 6 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 5ffed3d5ac7942c4beebc135e767065b(size=43.5 M), total size for store is 145.5 M. This selection was in queue for 0sec, and took 8sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2382:2016-11-08 03:53:41,115 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=6, fileSize=34.9 M, priority=3, time=729197852549441; duration=8sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2388:2016-11-08 03:53:41,748 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2765, memsize=73.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/bc02eb0f54c1494a9c65f863ef5f6dea ./node-4/hbase-root-regionserver-node-4.cluster.log:2393:2016-11-08 03:53:42,371 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2765, memsize=21.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/843615ceb09040439b53672f2d8f4804 ./node-4/hbase-root-regionserver-node-4.cluster.log:2395:2016-11-08 03:53:42,433 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f3fd1cbd951447439482592925e99a36, entries=124938, sequenceid=2765, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2396:2016-11-08 03:53:42,449 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/bc02eb0f54c1494a9c65f863ef5f6dea, entries=374814, sequenceid=2765, filesize=6.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2397:2016-11-08 03:53:42,465 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/843615ceb09040439b53672f2d8f4804, entries=124938, sequenceid=2765, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2400:2016-11-08 03:53:42,622 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~134.58 MB/141116320, currentsize=134.67 MB/141210496 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4747ms, sequenceid=2765, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2401:2016-11-08 03:53:42,643 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:2403:2016-11-08 03:53:43,227 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into e4c9aa41479b4e3cabbc151b2ef98885(size=12.9 M), total size for store is 147.8 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2404:2016-11-08 03:53:43,227 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=15.2 M, priority=0, time=729201480242650; duration=7sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2405:2016-11-08 03:53:43,239 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2406:2016-11-08 03:53:43,239 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 9 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=83.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2419:2016-11-08 03:53:44,775 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2868, memsize=49.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a53029b1f3004879bcc0137a5778c4d7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2422:2016-11-08 03:53:47,364 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2868, memsize=91.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d372102245294bfeb96639ab8028578a ./node-4/hbase-root-regionserver-node-4.cluster.log:2423:2016-11-08 03:53:48,029 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2868, memsize=25.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/948627757f0942229eba03b2aaa5c9f7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2424:2016-11-08 03:53:48,112 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/a53029b1f3004879bcc0137a5778c4d7, entries=153662, sequenceid=2868, filesize=4.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2425:2016-11-08 03:53:48,145 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/d372102245294bfeb96639ab8028578a, entries=460986, sequenceid=2868, filesize=8.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2426:2016-11-08 03:53:48,193 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/948627757f0942229eba03b2aaa5c9f7, entries=153662, sequenceid=2868, filesize=3.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2427:2016-11-08 03:53:48,203 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~166.24 MB/174313536, currentsize=147.76 MB/154941312 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4660ms, sequenceid=2868, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2429:2016-11-08 03:53:49,264 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2965, memsize=46.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/55a934dabe8b456981034db78ee99434 ./node-4/hbase-root-regionserver-node-4.cluster.log:2430:2016-11-08 03:53:51,467 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2965, memsize=86.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b04f077532ac4475a5abce57a5cd6c97 ./node-4/hbase-root-regionserver-node-4.cluster.log:2431:2016-11-08 03:53:52,171 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=2965, memsize=24.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c4101748d37d446b8853bcc3d95cda07 ./node-4/hbase-root-regionserver-node-4.cluster.log:2432:2016-11-08 03:53:52,264 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/55a934dabe8b456981034db78ee99434, entries=146065, sequenceid=2965, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2433:2016-11-08 03:53:52,292 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/b04f077532ac4475a5abce57a5cd6c97, entries=438195, sequenceid=2965, filesize=8.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2434:2016-11-08 03:53:52,344 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/c4101748d37d446b8853bcc3d95cda07, entries=146065, sequenceid=2965, filesize=3.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2436:2016-11-08 03:53:52,503 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~158.24 MB/165929840, currentsize=135.26 MB/141830736 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4260ms, sequenceid=2965, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2437:2016-11-08 03:53:52,744 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:2441:2016-11-08 03:53:53,148 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2442:2016-11-08 03:53:53,148 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=16.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2464:2016-11-08 03:54:02,325 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into eb3fc5e1347e4586aae02b375d6b0005(size=14.3 M), total size for store is 163.2 M. This selection was in queue for 0sec, and took 9sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2465:2016-11-08 03:54:02,325 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=16.3 M, priority=-1, time=729218549092209; duration=9sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2466:2016-11-08 03:54:02,331 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2467:2016-11-08 03:54:02,331 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 8 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=73.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2482:2016-11-08 03:54:09,939 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 9 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ac56f65576904aabab459ee868300fa0(size=81.2 M), total size for store is 88.9 M. This selection was in queue for 0sec, and took 26sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2483:2016-11-08 03:54:09,939 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=83.6 M, priority=2, time=729208640247490; duration=26sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2491:2016-11-08 03:54:12,353 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3274, memsize=154.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ec40d82ffec547e8b66fea233105c59c ./node-4/hbase-root-regionserver-node-4.cluster.log:2492:2016-11-08 03:54:16,287 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3274, memsize=286.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1e24c4adb95d48ff9fe56e69cd3e7cef ./node-4/hbase-root-regionserver-node-4.cluster.log:2493:2016-11-08 03:54:17,239 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3274, memsize=80.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/948647f39266455093da1cc68a0d8189 ./node-4/hbase-root-regionserver-node-4.cluster.log:2494:2016-11-08 03:54:17,248 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ec40d82ffec547e8b66fea233105c59c, entries=480680, sequenceid=3274, filesize=12.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2495:2016-11-08 03:54:17,254 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/1e24c4adb95d48ff9fe56e69cd3e7cef, entries=1442040, sequenceid=3274, filesize=30.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2496:2016-11-08 03:54:17,260 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/948647f39266455093da1cc68a0d8189, entries=480680, sequenceid=3274, filesize=12.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2497:2016-11-08 03:54:17,263 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~520.76 MB/546052480, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7100ms, sequenceid=3274, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2498:2016-11-08 03:54:24,033 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 8 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into d4f813b9dd3c46a4bb490906d1a6c6b4(size=76.7 M), total size for store is 197.2 M. This selection was in queue for 0sec, and took 21sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2499:2016-11-08 03:54:24,033 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=8, fileSize=73.0 M, priority=2, time=729227732408183; duration=21sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2524:2016-11-08 03:54:30,348 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3353, memsize=38.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2c792dc563f24a469d9393401c73f800 ./node-4/hbase-root-regionserver-node-4.cluster.log:2525:2016-11-08 03:54:31,795 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3353, memsize=71.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4a343f6559344730b99f86df96199e07 ./node-4/hbase-root-regionserver-node-4.cluster.log:2526:2016-11-08 03:54:32,124 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3353, memsize=20.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d5b2dfba61c145b7aa2d753835ed29f4 ./node-4/hbase-root-regionserver-node-4.cluster.log:2527:2016-11-08 03:54:32,162 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/2c792dc563f24a469d9393401c73f800, entries=120789, sequenceid=3353, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2528:2016-11-08 03:54:32,180 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/4a343f6559344730b99f86df96199e07, entries=362367, sequenceid=3353, filesize=7.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2529:2016-11-08 03:54:32,212 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/d5b2dfba61c145b7aa2d753835ed29f4, entries=120789, sequenceid=3353, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2530:2016-11-08 03:54:32,305 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~130.86 MB/137216304, currentsize=115.84 MB/121470208 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3415ms, sequenceid=3353, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2538:2016-11-08 03:54:33,387 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3432, memsize=38.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/636ac47680a24db990dad0d5fbd0bee7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2542:2016-11-08 03:54:35,146 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3432, memsize=71.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/593f5a316da642ed98e1223a91362ab1 ./node-4/hbase-root-regionserver-node-4.cluster.log:2543:2016-11-08 03:54:35,466 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3432, memsize=20.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8365cb7c1544454590681ea81b008ee7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2544:2016-11-08 03:54:35,508 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/636ac47680a24db990dad0d5fbd0bee7, entries=120662, sequenceid=3432, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2545:2016-11-08 03:54:35,533 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/593f5a316da642ed98e1223a91362ab1, entries=361986, sequenceid=3432, filesize=6.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2546:2016-11-08 03:54:35,623 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8365cb7c1544454590681ea81b008ee7, entries=120662, sequenceid=3432, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2548:2016-11-08 03:54:35,835 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~130.72 MB/137072032, currentsize=104.86 MB/109950032 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3140ms, sequenceid=3432, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2551:2016-11-08 03:54:37,229 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3510, memsize=38.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e891bd4e31864a9d84f35de32a2ca07d ./node-4/hbase-root-regionserver-node-4.cluster.log:2553:2016-11-08 03:54:39,211 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3510, memsize=71.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a30108fd09c44655a11b754b53921388 ./node-4/hbase-root-regionserver-node-4.cluster.log:2555:2016-11-08 03:54:39,742 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3510, memsize=20.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/29af8333b32b44ea97294fc8766906f2 ./node-4/hbase-root-regionserver-node-4.cluster.log:2556:2016-11-08 03:54:39,844 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/e891bd4e31864a9d84f35de32a2ca07d, entries=119848, sequenceid=3510, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2557:2016-11-08 03:54:39,907 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/a30108fd09c44655a11b754b53921388, entries=359544, sequenceid=3510, filesize=6.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2558:2016-11-08 03:54:39,973 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/29af8333b32b44ea97294fc8766906f2, entries=119848, sequenceid=3510, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2560:2016-11-08 03:54:40,163 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~129.84 MB/136147328, currentsize=107.43 MB/112653712 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3915ms, sequenceid=3510, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2575:2016-11-08 03:54:42,927 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3596, memsize=43.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f045fdb8ecf84bbbbe54fe06fe170bba ./node-4/hbase-root-regionserver-node-4.cluster.log:2578:2016-11-08 03:54:43,074 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2579:2016-11-08 03:54:43,074 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 8 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=76.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2586:2016-11-08 03:54:45,562 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3596, memsize=80.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2a029f2239aa41f9a98b94b9d9536e56 ./node-4/hbase-root-regionserver-node-4.cluster.log:2590:2016-11-08 03:54:46,785 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3596, memsize=22.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e0b3caa923f74e768adc4627410c281f ./node-4/hbase-root-regionserver-node-4.cluster.log:2593:2016-11-08 03:54:46,859 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f045fdb8ecf84bbbbe54fe06fe170bba, entries=135783, sequenceid=3596, filesize=3.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2594:2016-11-08 03:54:46,881 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/2a029f2239aa41f9a98b94b9d9536e56, entries=407349, sequenceid=3596, filesize=7.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2595:2016-11-08 03:54:46,900 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e0b3caa923f74e768adc4627410c281f, entries=135783, sequenceid=3596, filesize=3.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2596:2016-11-08 03:54:47,030 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~147.10 MB/154249488, currentsize=120.54 MB/126397040 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5346ms, sequenceid=3596, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2600:2016-11-08 03:54:48,551 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3673, memsize=38.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c49a0c2d8d0940089ca5514d4ce5e900 ./node-4/hbase-root-regionserver-node-4.cluster.log:2605:2016-11-08 03:54:50,723 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3673, memsize=72.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9ce8fd0f993746d09d22ed0adfdebd24 ./node-4/hbase-root-regionserver-node-4.cluster.log:2606:2016-11-08 03:54:51,214 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3673, memsize=20.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8066afa389fb4815a8e05997b06ff8d5 ./node-4/hbase-root-regionserver-node-4.cluster.log:2607:2016-11-08 03:54:51,321 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/c49a0c2d8d0940089ca5514d4ce5e900, entries=121356, sequenceid=3673, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2608:2016-11-08 03:54:51,418 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/9ce8fd0f993746d09d22ed0adfdebd24, entries=364068, sequenceid=3673, filesize=7.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2609:2016-11-08 03:54:51,486 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8066afa389fb4815a8e05997b06ff8d5, entries=121356, sequenceid=3673, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2611:2016-11-08 03:54:51,799 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~131.47 MB/137860416, currentsize=100.96 MB/105863840 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4378ms, sequenceid=3673, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2613:2016-11-08 03:54:52,431 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:2631:2016-11-08 03:54:58,091 INFO [PriorityRpcServer.handler=8,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:2633:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:2643:2016-11-08 03:54:58,426 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2645:2016-11-08 03:54:58,426 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=8, fileSize=76.3 M (43.5 M, 3.2 M, 4.0 M, 3.7 M, 12.7 M, 3.1 M, 3.1 M, 3.0 M), priority=2, time=729268475472953; duration=15sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2656:2016-11-08 03:55:01,073 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3842, memsize=87.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a38373bbadcb4f1a8e7e7ab49178799e ./node-4/hbase-root-regionserver-node-4.cluster.log:2667:2016-11-08 03:55:04,284 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3842, memsize=163.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7d768bf5be044ae18507786acbb43811 ./node-4/hbase-root-regionserver-node-4.cluster.log:2668:2016-11-08 03:55:05,843 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3842, memsize=46.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8e8e4c70dd144df595fae1db89e0f3e6 ./node-4/hbase-root-regionserver-node-4.cluster.log:2669:2016-11-08 03:55:05,864 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/a38373bbadcb4f1a8e7e7ab49178799e, entries=274169, sequenceid=3842, filesize=7.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2670:2016-11-08 03:55:05,887 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/7d768bf5be044ae18507786acbb43811, entries=822507, sequenceid=3842, filesize=16.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2671:2016-11-08 03:55:05,896 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8e8e4c70dd144df595fae1db89e0f3e6, entries=274169, sequenceid=3842, filesize=7.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2672:2016-11-08 03:55:05,971 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~297.03 MB/311455984, currentsize=198.10 MB/207719872 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7545ms, sequenceid=3842, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2679:2016-11-08 03:55:07,775 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4149, memsize=61.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ab8709fa4814429389c69d3c4101854b ./node-4/hbase-root-regionserver-node-4.cluster.log:2690:2016-11-08 03:55:09,899 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4149, memsize=114.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d4c47b00952c477e82924972d3980369 ./node-4/hbase-root-regionserver-node-4.cluster.log:2691:2016-11-08 03:55:10,816 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4149, memsize=32.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/36a2b3c475da4db489b72619665a4942 ./node-4/hbase-root-regionserver-node-4.cluster.log:2692:2016-11-08 03:55:10,863 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ab8709fa4814429389c69d3c4101854b, entries=192531, sequenceid=4149, filesize=5.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2693:2016-11-08 03:55:10,908 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/d4c47b00952c477e82924972d3980369, entries=577593, sequenceid=4149, filesize=11.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2694:2016-11-08 03:55:10,965 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/36a2b3c475da4db489b72619665a4942, entries=192531, sequenceid=4149, filesize=4.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2695:2016-11-08 03:55:10,975 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~208.58 MB/218715216, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4820ms, sequenceid=4149, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2696:2016-11-08 03:55:10,979 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed TbWaF ./node-4/hbase-root-regionserver-node-4.cluster.log:2697:2016-11-08 03:55:10,987 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:2698:2016-11-08 03:55:11,000 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:2699:2016-11-08 03:55:11,019 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:2700:2016-11-08 03:55:11,040 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2701:2016-11-08 03:55:11,079 INFO [PriorityRpcServer.handler=13,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2704:2016-11-08 03:55:11,131 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for TbWaF: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2705:2016-11-08 03:55:11,131 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2708:2016-11-08 03:55:11,152 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2709:2016-11-08 03:55:11,152 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2710:2016-11-08 03:55:11,316 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2711:2016-11-08 03:55:11,316 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2712:2016-11-08 03:55:11,506 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:2713:2016-11-08 03:55:11,506 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:2714:2016-11-08 03:55:11,736 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=4153 ./node-4/hbase-root-regionserver-node-4.cluster.log:2715:2016-11-08 03:55:11,775 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2716:2016-11-08 03:55:11,803 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:2756:2016-11-08 03:55:13,183 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2757:2016-11-08 03:55:13,184 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2772:2016-11-08 03:55:13,223 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2773:2016-11-08 03:55:13,223 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2776:2016-11-08 03:55:14,962 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into f10807ef0cd34c37ad6da2dd4b806bf5(size=6.7 M), total size for store is 126.1 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2777:2016-11-08 03:55:14,962 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=9.1 M, priority=-1, time=729298624118714; duration=1sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2778:2016-11-08 03:55:14,965 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2779:2016-11-08 03:55:14,966 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=20.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2781:2016-11-08 03:55:15,575 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 7ba33abf32d34adbabb5b46702c7f7c0(size=13.2 M), total size for store is 201.0 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2782:2016-11-08 03:55:15,575 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=9.2 M, priority=-3, time=729298584821499; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2784:2016-11-08 03:55:15,595 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2785:2016-11-08 03:55:15,596 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=10.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2820:2016-11-08 03:55:18,491 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 30756e11c491490381b9a1149795274a(size=15.7 M), total size for store is 205.9 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2821:2016-11-08 03:55:18,491 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=10.9 M, priority=-1, time=729300996822654; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2827:2016-11-08 03:55:19,843 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4235, memsize=39.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/807a349f0d0241709cd0517fd0a4944d ./node-4/hbase-root-regionserver-node-4.cluster.log:2832:2016-11-08 03:55:21,367 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 9065cca713904533bc86217304aa320a(size=17.8 M), total size for store is 258.2 M. This selection was in queue for 0sec, and took 6sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2833:2016-11-08 03:55:21,367 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=20.8 M, priority=0, time=729300366771406; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2838:2016-11-08 03:55:22,270 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4235, memsize=72.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/67c8c568718544b39e5e23bb29849cf7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2842:2016-11-08 03:55:22,693 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4235, memsize=20.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6813ecc78919422e984c1bd92fdc2249 ./node-4/hbase-root-regionserver-node-4.cluster.log:2843:2016-11-08 03:55:22,744 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/807a349f0d0241709cd0517fd0a4944d, entries=121657, sequenceid=4235, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2844:2016-11-08 03:55:22,785 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/67c8c568718544b39e5e23bb29849cf7, entries=364971, sequenceid=4235, filesize=7.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2845:2016-11-08 03:55:22,800 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/6813ecc78919422e984c1bd92fdc2249, entries=121657, sequenceid=4235, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2846:2016-11-08 03:55:23,132 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~131.80 MB/138202352, currentsize=111.45 MB/116866000 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4546ms, sequenceid=4235, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2848:2016-11-08 03:55:24,512 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4317, memsize=39.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/370865defd624b5c9c3de8fec1f2f1cd ./node-4/hbase-root-regionserver-node-4.cluster.log:2850:2016-11-08 03:55:26,348 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4317, memsize=73.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6a128fd9585941c5a9ced097138c3421 ./node-4/hbase-root-regionserver-node-4.cluster.log:2851:2016-11-08 03:55:26,931 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4317, memsize=20.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a11e17a72de6466f8572d9c37daf9e61 ./node-4/hbase-root-regionserver-node-4.cluster.log:2852:2016-11-08 03:55:26,942 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/370865defd624b5c9c3de8fec1f2f1cd, entries=123759, sequenceid=4317, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2853:2016-11-08 03:55:26,953 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6a128fd9585941c5a9ced097138c3421, entries=371277, sequenceid=4317, filesize=7.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2854:2016-11-08 03:55:26,994 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/a11e17a72de6466f8572d9c37daf9e61, entries=123759, sequenceid=4317, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2855:2016-11-08 03:55:27,007 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~134.08 MB/140590224, currentsize=104.38 MB/109450192 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3537ms, sequenceid=4317, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2856:2016-11-08 03:55:27,746 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:2876:2016-11-08 03:55:34,379 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2877:2016-11-08 03:55:34,379 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=11.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2881:2016-11-08 03:55:37,942 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into acfc2e037d5d4076bd6d77a0e87d47c4(size=16.3 M), total size for store is 217.1 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2882:2016-11-08 03:55:37,942 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=11.2 M, priority=-1, time=729319779958207; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2883:2016-11-08 03:55:37,964 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2884:2016-11-08 03:55:37,964 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=11.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2894:2016-11-08 03:55:41,868 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 04dec427d2df4a699f3d09d1e2c1e4b8(size=8.3 M), total size for store is 129.5 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2895:2016-11-08 03:55:41,868 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=11.1 M, priority=-1, time=729323364993470; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2896:2016-11-08 03:55:41,878 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2897:2016-11-08 03:55:41,878 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=25.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2906:2016-11-08 03:55:45,340 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4617, memsize=154.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3a15de237a91429791fb33d4f14cb08d ./node-4/hbase-root-regionserver-node-4.cluster.log:2907:2016-11-08 03:55:47,955 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1da2d636830447819b93faa65648411c(size=21.9 M), total size for store is 268.6 M. This selection was in queue for 0sec, and took 6sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2908:2016-11-08 03:55:47,955 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=25.7 M, priority=0, time=729327279357794; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2911:2016-11-08 03:55:49,911 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4617, memsize=286.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/073e638b70af4b699c62f0eba74f3aaa ./node-4/hbase-root-regionserver-node-4.cluster.log:2912:2016-11-08 03:55:50,985 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4617, memsize=80.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ddb1f0d8c7df4f75bd80f56b05fc88da ./node-4/hbase-root-regionserver-node-4.cluster.log:2913:2016-11-08 03:55:51,012 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/3a15de237a91429791fb33d4f14cb08d, entries=482081, sequenceid=4617, filesize=12.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2914:2016-11-08 03:55:51,022 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/073e638b70af4b699c62f0eba74f3aaa, entries=1446243, sequenceid=4617, filesize=30.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2915:2016-11-08 03:55:51,031 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/ddb1f0d8c7df4f75bd80f56b05fc88da, entries=482081, sequenceid=4617, filesize=12.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2916:2016-11-08 03:55:51,052 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~522.27 MB/547644016, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 8549ms, sequenceid=4617, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2920:2016-11-08 03:55:54,995 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2921:2016-11-08 03:55:54,995 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=13.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2924:2016-11-08 03:55:57,109 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2925:2016-11-08 03:55:57,109 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=13.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2929:2016-11-08 03:55:57,716 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ac63f8f89c5d4aa08161802b7064911a(size=19.9 M), total size for store is 236.1 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2930:2016-11-08 03:55:57,717 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=13.7 M, priority=0, time=729340396098467; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2935:2016-11-08 03:55:59,350 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into b1d15b6256c446c0b3c2d551f1a7ea1c(size=11.8 M), total size for store is 140.1 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:2936:2016-11-08 03:55:59,350 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=13.2 M, priority=0, time=729342510030848; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:2946:2016-11-08 03:56:02,267 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4698, memsize=38.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/cefc47642fd0458caf7b80011f70b824 ./node-4/hbase-root-regionserver-node-4.cluster.log:2952:2016-11-08 03:56:04,058 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4698, memsize=71.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/162d50c178eb48c882d84626f599dd7a ./node-4/hbase-root-regionserver-node-4.cluster.log:2958:2016-11-08 03:56:04,860 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4698, memsize=20.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/12f7716b92b444d19170de955552fce7 ./node-4/hbase-root-regionserver-node-4.cluster.log:2959:2016-11-08 03:56:04,903 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/cefc47642fd0458caf7b80011f70b824, entries=119887, sequenceid=4698, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2960:2016-11-08 03:56:04,920 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/162d50c178eb48c882d84626f599dd7a, entries=359661, sequenceid=4698, filesize=6.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2961:2016-11-08 03:56:04,927 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/12f7716b92b444d19170de955552fce7, entries=119887, sequenceid=4698, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2962:2016-11-08 03:56:05,235 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~129.88 MB/136191632, currentsize=122.14 MB/128073776 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3836ms, sequenceid=4698, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2966:2016-11-08 03:56:07,056 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4779, memsize=40.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/39729364725f4747becd8afa898e8c6b ./node-4/hbase-root-regionserver-node-4.cluster.log:2968:2016-11-08 03:56:08,931 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4779, memsize=76.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3dc1b48bb9ac4ce4ab0b3009e7c9709c ./node-4/hbase-root-regionserver-node-4.cluster.log:2972:2016-11-08 03:56:09,519 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=4779, memsize=21.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ac98d591b55c4e30a07113b2194a61eb ./node-4/hbase-root-regionserver-node-4.cluster.log:2973:2016-11-08 03:56:09,576 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/39729364725f4747becd8afa898e8c6b, entries=127687, sequenceid=4779, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2974:2016-11-08 03:56:09,597 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/3dc1b48bb9ac4ce4ab0b3009e7c9709c, entries=383061, sequenceid=4779, filesize=7.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2975:2016-11-08 03:56:09,624 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/ac98d591b55c4e30a07113b2194a61eb, entries=127687, sequenceid=4779, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:2976:2016-11-08 03:56:09,673 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~138.33 MB/145052432, currentsize=125.11 MB/131186416 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4201ms, sequenceid=4779, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:2977:2016-11-08 03:56:09,783 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:2981:2016-11-08 03:56:09,919 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:2982:2016-11-08 03:56:09,919 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=32.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3011:2016-11-08 03:56:22,059 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:3014:2016-11-08 03:56:22,478 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2a15a1bfc76d48f5ae7a3a8f497a0cf5(size=31.4 M), total size for store is 311.9 M. This selection was in queue for 0sec, and took 12sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3015:2016-11-08 03:56:22,478 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=32.6 M, priority=-1, time=729355320045433; duration=12sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3016:2016-11-08 03:56:22,479 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3027:2016-11-08 03:56:25,444 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5085, memsize=153.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/967b54afce87407194e814ac13cf1a5f ./node-4/hbase-root-regionserver-node-4.cluster.log:3028:2016-11-08 03:56:29,706 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5085, memsize=285.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7b2b9b2516cf46e1ac65bed987a5d5bc ./node-4/hbase-root-regionserver-node-4.cluster.log:3034:2016-11-08 03:56:30,735 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5085, memsize=80.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/57b6afbce7d84f4d8fc6b87fbf8d100f ./node-4/hbase-root-regionserver-node-4.cluster.log:3035:2016-11-08 03:56:30,758 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/967b54afce87407194e814ac13cf1a5f, entries=479337, sequenceid=5085, filesize=12.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3036:2016-11-08 03:56:30,791 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/7b2b9b2516cf46e1ac65bed987a5d5bc, entries=1438011, sequenceid=5085, filesize=30.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3037:2016-11-08 03:56:30,840 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/57b6afbce7d84f4d8fc6b87fbf8d100f, entries=479337, sequenceid=5085, filesize=12.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3038:2016-11-08 03:56:30,849 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~519.30 MB/544526832, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 8370ms, sequenceid=5085, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3039:2016-11-08 03:56:30,855 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed TbWaF ./node-4/hbase-root-regionserver-node-4.cluster.log:3040:2016-11-08 03:56:30,863 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:3041:2016-11-08 03:56:30,877 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:3042:2016-11-08 03:56:30,892 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:3043:2016-11-08 03:56:30,935 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3044:2016-11-08 03:56:30,979 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3045:2016-11-08 03:56:31,055 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3046:2016-11-08 03:56:31,055 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3047:2016-11-08 03:56:31,349 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3048:2016-11-08 03:56:31,349 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3049:2016-11-08 03:56:31,522 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3050:2016-11-08 03:56:31,522 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3055:2016-11-08 03:56:31,767 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=5089 ./node-4/hbase-root-regionserver-node-4.cluster.log:3056:2016-11-08 03:56:31,775 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3057:2016-11-08 03:56:31,803 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:3065:2016-11-08 03:56:32,149 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3066:2016-11-08 03:56:32,149 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=19.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3110:2016-11-08 03:56:34,078 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3111:2016-11-08 03:56:34,078 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=18.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3126:2016-11-08 03:56:37,039 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into e08c674e2cae4c25976afa6b34126861(size=27.8 M), total size for store is 263.8 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3127:2016-11-08 03:56:37,039 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=19.0 M, priority=-1, time=729377550049291; duration=4sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3128:2016-11-08 03:56:37,044 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3129:2016-11-08 03:56:37,044 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3131:2016-11-08 03:56:37,409 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6e02275b9bf04f3ca9924ec209460cc1(size=14.4 M), total size for store is 154.5 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3132:2016-11-08 03:56:37,409 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=18.4 M, priority=-1, time=729379478935002; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3157:2016-11-08 03:56:40,315 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:3159:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:3169:2016-11-08 03:56:40,373 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=44.6 M (30.4 M, 6.9 M, 7.3 M), priority=0, time=729382445623476; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3176:2016-11-08 03:56:41,036 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5171, memsize=39.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/683a75a486154191acc8d4fe3e63ef70 ./node-4/hbase-root-regionserver-node-4.cluster.log:3177:2016-11-08 03:56:42,752 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5171, memsize=72.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b08c0969c88a4fb6a27b86de63b4d9fd ./node-4/hbase-root-regionserver-node-4.cluster.log:3184:2016-11-08 03:56:43,516 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5171, memsize=20.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/62eea974a92d47418db7944bc8163de2 ./node-4/hbase-root-regionserver-node-4.cluster.log:3185:2016-11-08 03:56:43,540 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/683a75a486154191acc8d4fe3e63ef70, entries=122060, sequenceid=5171, filesize=2.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3186:2016-11-08 03:56:43,572 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/b08c0969c88a4fb6a27b86de63b4d9fd, entries=366180, sequenceid=5171, filesize=7.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3187:2016-11-08 03:56:43,604 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/62eea974a92d47418db7944bc8163de2, entries=122060, sequenceid=5171, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3188:2016-11-08 03:56:43,614 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~132.24 MB/138660160, currentsize=98.55 MB/103336240 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3528ms, sequenceid=5171, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3189:2016-11-08 03:56:43,615 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3195:2016-11-08 03:56:44,090 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5232, memsize=29.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7eb072533d8e4622bfa33887a8fd381e ./node-4/hbase-root-regionserver-node-4.cluster.log:3196:2016-11-08 03:56:44,762 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:3197:2016-11-08 03:56:45,475 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5232, memsize=54.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7d8afddc56564f5a8ddeb80223edf486 ./node-4/hbase-root-regionserver-node-4.cluster.log:3198:2016-11-08 03:56:45,735 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5232, memsize=15.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/75cbe75655fc48218f622f9e1241e1c2 ./node-4/hbase-root-regionserver-node-4.cluster.log:3199:2016-11-08 03:56:45,758 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/7eb072533d8e4622bfa33887a8fd381e, entries=90965, sequenceid=5232, filesize=2.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3200:2016-11-08 03:56:45,772 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/7d8afddc56564f5a8ddeb80223edf486, entries=272895, sequenceid=5232, filesize=5.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3201:2016-11-08 03:56:45,805 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/75cbe75655fc48218f622f9e1241e1c2, entries=90965, sequenceid=5232, filesize=2.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3202:2016-11-08 03:56:45,928 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~98.55 MB/103336240, currentsize=68.54 MB/71873584 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2312ms, sequenceid=5232, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3204:2016-11-08 03:56:46,727 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5280, memsize=22.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ceae7d3af84042278a6d6833afec192e ./node-4/hbase-root-regionserver-node-4.cluster.log:3205:2016-11-08 03:56:47,997 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5280, memsize=41.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/17b404bf28be4ed6b9ff4b571c1529f5 ./node-4/hbase-root-regionserver-node-4.cluster.log:3206:2016-11-08 03:56:48,282 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5280, memsize=11.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/60a94f58fabb434ea80d21243740e88b ./node-4/hbase-root-regionserver-node-4.cluster.log:3207:2016-11-08 03:56:48,347 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ceae7d3af84042278a6d6833afec192e, entries=69763, sequenceid=5280, filesize=1.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3208:2016-11-08 03:56:48,379 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/17b404bf28be4ed6b9ff4b571c1529f5, entries=209289, sequenceid=5280, filesize=3.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3209:2016-11-08 03:56:48,389 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/60a94f58fabb434ea80d21243740e88b, entries=69763, sequenceid=5280, filesize=1.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3210:2016-11-08 03:56:48,393 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~75.58 MB/79250768, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2237ms, sequenceid=5280, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3211:2016-11-08 03:56:48,398 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:3212:2016-11-08 03:56:48,401 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:3213:2016-11-08 03:56:48,407 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:3214:2016-11-08 03:56:48,434 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3263:2016-11-08 03:57:14,711 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3264:2016-11-08 03:57:14,743 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3265:2016-11-08 03:57:14,744 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3266:2016-11-08 03:57:14,811 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3267:2016-11-08 03:57:14,811 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3268:2016-11-08 03:57:14,926 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3269:2016-11-08 03:57:14,926 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3270:2016-11-08 03:57:15,035 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Replaying edits from hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005402 ./node-4/hbase-root-regionserver-node-4.cluster.log:3272:2016-11-08 03:57:19,248 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5343, memsize=38.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1c144053d6d645aca9a49782dd821031 ./node-4/hbase-root-regionserver-node-4.cluster.log:3275:2016-11-08 03:57:20,167 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5343, memsize=71.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6e7f856cba85444aaa7c1c8e3d56cef6 ./node-4/hbase-root-regionserver-node-4.cluster.log:3279:2016-11-08 03:57:20,398 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5343, memsize=20.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/910117d58445428c8bbd4d95990333ab ./node-4/hbase-root-regionserver-node-4.cluster.log:3280:2016-11-08 03:57:20,409 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/1c144053d6d645aca9a49782dd821031, entries=119540, sequenceid=5343, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3281:2016-11-08 03:57:20,422 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6e7f856cba85444aaa7c1c8e3d56cef6, entries=358620, sequenceid=5343, filesize=6.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3282:2016-11-08 03:57:20,432 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/910117d58445428c8bbd4d95990333ab, entries=119540, sequenceid=5343, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3283:2016-11-08 03:57:20,432 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~129.51 MB/135797440, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 1599ms, sequenceid=5343, compaction requested=true; wal=null ./node-4/hbase-root-regionserver-node-4.cluster.log:3287:2016-11-08 03:57:24,158 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5390, memsize=38.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9a8322e04d7344488fb5913819f1ffb9 ./node-4/hbase-root-regionserver-node-4.cluster.log:3288:2016-11-08 03:57:24,976 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5390, memsize=71.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/65a2b4af27754818969eb9bae876f266 ./node-4/hbase-root-regionserver-node-4.cluster.log:3289:2016-11-08 03:57:25,146 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5390, memsize=20.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ebe4fa46ff3d4326bbfaae4e1e023163 ./node-4/hbase-root-regionserver-node-4.cluster.log:3290:2016-11-08 03:57:25,154 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/9a8322e04d7344488fb5913819f1ffb9, entries=119672, sequenceid=5390, filesize=2.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3291:2016-11-08 03:57:25,160 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/65a2b4af27754818969eb9bae876f266, entries=359016, sequenceid=5390, filesize=6.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3292:2016-11-08 03:57:25,167 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/ebe4fa46ff3d4326bbfaae4e1e023163, entries=119672, sequenceid=5390, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3293:2016-11-08 03:57:25,167 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~129.65 MB/135947392, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 1280ms, sequenceid=5390, compaction requested=true; wal=null ./node-4/hbase-root-regionserver-node-4.cluster.log:3294:2016-11-08 03:57:25,727 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Replaying edits from hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000005415 ./node-4/hbase-root-regionserver-node-4.cluster.log:3296:2016-11-08 03:57:26,826 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5415, memsize=19.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2ed13fbbf8ea408db99764f07799562e ./node-4/hbase-root-regionserver-node-4.cluster.log:3297:2016-11-08 03:57:27,413 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5415, memsize=36.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/96a1fbb1f47147a78b2ef2e20e9f0ad8 ./node-4/hbase-root-regionserver-node-4.cluster.log:3298:2016-11-08 03:57:27,496 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5415, memsize=10.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3708f647b8a84e61adc10c503fa0de7e ./node-4/hbase-root-regionserver-node-4.cluster.log:3299:2016-11-08 03:57:27,508 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/2ed13fbbf8ea408db99764f07799562e, entries=60700, sequenceid=5415, filesize=1.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3300:2016-11-08 03:57:27,512 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/96a1fbb1f47147a78b2ef2e20e9f0ad8, entries=182100, sequenceid=5415, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3301:2016-11-08 03:57:27,520 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/3708f647b8a84e61adc10c503fa0de7e, entries=60700, sequenceid=5415, filesize=1.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3302:2016-11-08 03:57:27,520 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Finished memstore flush of ~65.76 MB/68955200, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 910ms, sequenceid=5415, compaction requested=true; wal=null ./node-4/hbase-root-regionserver-node-4.cluster.log:3303:2016-11-08 03:57:27,527 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=5416 ./node-4/hbase-root-regionserver-node-4.cluster.log:3304:2016-11-08 03:57:27,539 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3305:2016-11-08 03:57:27,547 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:3306:2016-11-08 03:57:27,565 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3307:2016-11-08 03:57:27,565 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=16.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3308:2016-11-08 03:57:29,639 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 576fcfd209b4465fa275d9e57e92f22b(size=14.8 M), total size for store is 370.8 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3309:2016-11-08 03:57:29,640 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=16.8 M, priority=-4, time=729432966176714; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3310:2016-11-08 03:57:29,644 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3311:2016-11-08 03:57:29,644 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=7.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3312:2016-11-08 03:57:30,362 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 437c5441f1d34c33b865661e3411c980(size=5.8 M), total size for store is 165.6 M. This selection was in queue for 0sec, and took 0sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3313:2016-11-08 03:57:30,362 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=7.7 M, priority=-3, time=729435045399316; duration=0sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3314:2016-11-08 03:57:30,365 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3315:2016-11-08 03:57:30,365 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=7.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3316:2016-11-08 03:57:31,343 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into b6b4c0e71d334c3c97ea766e289a5351(size=10.7 M), total size for store is 284.7 M. This selection was in queue for 0sec, and took 0sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3317:2016-11-08 03:57:31,343 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=7.4 M, priority=-3, time=729435766329796; duration=0sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3318:2016-11-08 03:57:31,346 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3319:2016-11-08 03:57:31,346 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3322:2016-11-08 03:57:35,801 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3323:2016-11-08 03:57:35,801 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=33.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3324:2016-11-08 03:57:36,466 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2ae9316f364647dea399a7e71ab53741(size=38.1 M), total size for store is 364.3 M. This selection was in queue for 0sec, and took 5sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3325:2016-11-08 03:57:36,466 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=44.6 M, priority=-2, time=729436747679459; duration=5sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3326:2016-11-08 03:57:36,469 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3327:2016-11-08 03:57:36,469 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=19.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3328:2016-11-08 03:57:38,136 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2833b8e31b034c0d84e8170f8fe76396(size=15.5 M), total size for store is 161.4 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3329:2016-11-08 03:57:38,136 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=19.7 M, priority=-1, time=729441870559632; duration=1sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3330:2016-11-08 03:57:38,138 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3331:2016-11-08 03:57:38,138 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=58.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3332:2016-11-08 03:57:38,814 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into b8d09e37655647a2829ba7076b6b3169(size=40.7 M), total size for store is 291.9 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3333:2016-11-08 03:57:38,814 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=33.5 M, priority=-1, time=729441202329908; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3346:2016-11-08 03:57:45,142 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 0e9948da176b4bbbbee4e038df45cca0(size=55.5 M), total size for store is 360.9 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3347:2016-11-08 03:57:45,142 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=58.8 M, priority=0, time=729443539494043; duration=7sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3362:2016-11-08 03:57:50,675 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5497, memsize=41.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a8e314512d7044d3968880bb920c7fe6 ./node-4/hbase-root-regionserver-node-4.cluster.log:3367:2016-11-08 03:57:51,727 INFO [PriorityRpcServer.handler=9,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:3371:2016-11-08 03:57:53,212 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5497, memsize=76.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/977512a96f694aafb7bac11978ce8bfc ./node-4/hbase-root-regionserver-node-4.cluster.log:3372:2016-11-08 03:57:53,559 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5497, memsize=21.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0a34a73c108242c8952704e69269a390 ./node-4/hbase-root-regionserver-node-4.cluster.log:3373:2016-11-08 03:57:53,596 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/a8e314512d7044d3968880bb920c7fe6, entries=128303, sequenceid=5497, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3375:2016-11-08 03:57:53,629 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/977512a96f694aafb7bac11978ce8bfc, entries=384909, sequenceid=5497, filesize=7.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3376:2016-11-08 03:57:53,644 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/0a34a73c108242c8952704e69269a390, entries=128303, sequenceid=5497, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3377:2016-11-08 03:57:53,648 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~139.00 MB/145752208, currentsize=131.12 MB/137490080 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4583ms, sequenceid=5497, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3378:2016-11-08 03:57:53,648 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3388:2016-11-08 03:57:54,596 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5606, memsize=39.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e7603edc515845fdb77fb487ca52061b ./node-4/hbase-root-regionserver-node-4.cluster.log:3395:2016-11-08 03:57:56,669 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5606, memsize=73.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d331f3bb1d124526a021a6efa5ffe8b0 ./node-4/hbase-root-regionserver-node-4.cluster.log:3400:2016-11-08 03:57:56,997 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5606, memsize=20.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/955fe8e8b5844851a7cb518590be14d6 ./node-4/hbase-root-regionserver-node-4.cluster.log:3402:2016-11-08 03:57:57,047 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/e7603edc515845fdb77fb487ca52061b, entries=123362, sequenceid=5606, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3403:2016-11-08 03:57:57,056 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/d331f3bb1d124526a021a6efa5ffe8b0, entries=370086, sequenceid=5606, filesize=7.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3404:2016-11-08 03:57:57,096 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/955fe8e8b5844851a7cb518590be14d6, entries=123362, sequenceid=5606, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3405:2016-11-08 03:57:57,187 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Finished memstore flush of ~133.65 MB/140139232, currentsize=96.75 MB/101445936 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3539ms, sequenceid=5606, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3407:2016-11-08 03:57:58,273 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5743, memsize=31.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/34b1649b85ad457d9d495976be369c0c ./node-4/hbase-root-regionserver-node-4.cluster.log:3408:2016-11-08 03:57:59,142 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5743, memsize=58.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/73f8f364c32c43f29f38111947ce6f55 ./node-4/hbase-root-regionserver-node-4.cluster.log:3413:2016-11-08 03:57:59,539 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5743, memsize=16.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f6d83486b1084224a78fd7f89edd68e4 ./node-4/hbase-root-regionserver-node-4.cluster.log:3414:2016-11-08 03:57:59,562 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/34b1649b85ad457d9d495976be369c0c, entries=98113, sequenceid=5743, filesize=2.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3415:2016-11-08 03:57:59,568 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/73f8f364c32c43f29f38111947ce6f55, entries=294339, sequenceid=5743, filesize=5.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3416:2016-11-08 03:57:59,576 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/f6d83486b1084224a78fd7f89edd68e4, entries=98113, sequenceid=5743, filesize=2.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3417:2016-11-08 03:57:59,579 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Finished memstore flush of ~106.29 MB/111456368, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2161ms, sequenceid=5743, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3418:2016-11-08 03:57:59,581 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:3419:2016-11-08 03:57:59,582 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:3420:2016-11-08 03:57:59,583 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:3421:2016-11-08 03:57:59,597 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3422:2016-11-08 03:57:59,604 INFO [PriorityRpcServer.handler=11,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3423:2016-11-08 03:57:59,627 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3424:2016-11-08 03:57:59,627 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3425:2016-11-08 03:57:59,733 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3426:2016-11-08 03:57:59,733 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3427:2016-11-08 03:57:59,851 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3428:2016-11-08 03:57:59,851 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3429:2016-11-08 03:57:59,852 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3430:2016-11-08 03:57:59,852 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3431:2016-11-08 03:58:00,033 INFO [RS_OPEN_REGION-node-4:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=5747 ./node-4/hbase-root-regionserver-node-4.cluster.log:3432:2016-11-08 03:58:00,051 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3433:2016-11-08 03:58:00,056 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:3481:2016-11-08 03:58:03,864 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3482:2016-11-08 03:58:03,864 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=8.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3497:2016-11-08 03:58:04,395 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3498:2016-11-08 03:58:04,395 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=8.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3503:2016-11-08 03:58:04,911 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:3508:2016-11-08 03:58:06,692 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into e30cb411c9854c0b99fda6de98a6d04a(size=12.9 M), total size for store is 304.7 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3509:2016-11-08 03:58:06,692 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=8.8 M, priority=-2, time=729469265099297; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3510:2016-11-08 03:58:06,696 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3511:2016-11-08 03:58:06,696 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=20.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3512:2016-11-08 03:58:06,858 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 41b03a6a2cf7488ab2b790edbee85368(size=6.6 M), total size for store is 167.9 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3513:2016-11-08 03:58:06,859 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=8.9 M, priority=-2, time=729469796491401; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3514:2016-11-08 03:58:06,887 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3515:2016-11-08 03:58:06,887 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=17.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3561:2016-11-08 03:58:11,652 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into f23e4129de754082a4c0ff74ab54b166(size=18.6 M), total size for store is 168.9 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3562:2016-11-08 03:58:11,653 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=17.6 M, priority=0, time=729472288190755; duration=4sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3563:2016-11-08 03:58:11,666 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3564:2016-11-08 03:58:11,666 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=41.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3566:2016-11-08 03:58:11,851 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 34bbcd76a80a46d9814d22a8470d4e34(size=17.4 M), total size for store is 378.3 M. This selection was in queue for 0sec, and took 5sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3567:2016-11-08 03:58:11,851 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=20.3 M, priority=-1, time=729472097464519; duration=5sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3568:2016-11-08 03:58:11,854 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3569:2016-11-08 03:58:11,854 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 5 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=117.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3595:2016-11-08 03:58:13,687 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5955, memsize=89.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/cf377473be304eefbedc896331d8eb1b ./node-4/hbase-root-regionserver-node-4.cluster.log:3602:2016-11-08 03:58:17,287 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5955, memsize=165.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/fa35beacfa5347b196f2132cd6a1ca4e ./node-4/hbase-root-regionserver-node-4.cluster.log:3604:2016-11-08 03:58:18,451 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=5955, memsize=46.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7f0d1aa2a5cd4d0da0919de1d1e24ea0 ./node-4/hbase-root-regionserver-node-4.cluster.log:3605:2016-11-08 03:58:18,540 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/cf377473be304eefbedc896331d8eb1b, entries=277999, sequenceid=5955, filesize=7.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3606:2016-11-08 03:58:18,565 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/fa35beacfa5347b196f2132cd6a1ca4e, entries=833997, sequenceid=5955, filesize=17.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3607:2016-11-08 03:58:18,609 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/7f0d1aa2a5cd4d0da0919de1d1e24ea0, entries=277999, sequenceid=5955, filesize=7.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3608:2016-11-08 03:58:18,663 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~301.18 MB/315806864, currentsize=174.55 MB/183025504 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6540ms, sequenceid=5955, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3609:2016-11-08 03:58:18,681 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:3611:2016-11-08 03:58:20,044 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 4797b75e33b24b4da3f1c7858db16e7e(size=49.3 M), total size for store is 319.8 M. This selection was in queue for 0sec, and took 8sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3612:2016-11-08 03:58:20,044 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=41.7 M, priority=0, time=729477067295352; duration=8sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3613:2016-11-08 03:58:20,047 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3614:2016-11-08 03:58:20,047 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=70.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3624:2016-11-08 03:58:22,249 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6114, memsize=66.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ec0cbabbb806413d959ec610abd00a64 ./node-4/hbase-root-regionserver-node-4.cluster.log:3630:2016-11-08 03:58:24,939 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6114, memsize=123.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8270afd7ce384a44a0ef7b90c73ea42e ./node-4/hbase-root-regionserver-node-4.cluster.log:3634:2016-11-08 03:58:26,098 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6114, memsize=34.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/77098c09013046e6a630f949ccc56f56 ./node-4/hbase-root-regionserver-node-4.cluster.log:3635:2016-11-08 03:58:26,161 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ec0cbabbb806413d959ec610abd00a64, entries=206947, sequenceid=6114, filesize=5.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3636:2016-11-08 03:58:26,184 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/8270afd7ce384a44a0ef7b90c73ea42e, entries=620841, sequenceid=6114, filesize=12.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3637:2016-11-08 03:58:26,201 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/77098c09013046e6a630f949ccc56f56, entries=206947, sequenceid=6114, filesize=5.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3638:2016-11-08 03:58:26,260 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~224.20 MB/235091792, currentsize=135.94 MB/142547552 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5710ms, sequenceid=6114, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3639:2016-11-08 03:58:26,262 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:3663:2016-11-08 03:58:35,259 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 5 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into da5ceed942d64cbc944986607b97f127(size=124.2 M), total size for store is 331.7 M. This selection was in queue for 0sec, and took 23sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3664:2016-11-08 03:58:35,259 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=5, fileSize=117.6 M, priority=0, time=729477255463867; duration=23sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3665:2016-11-08 03:58:35,281 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3666:2016-11-08 03:58:35,281 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 5 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=140.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3677:2016-11-08 03:58:40,267 INFO [PriorityRpcServer.handler=16,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3687:2016-11-08 03:58:43,984 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into cbbb852faa554822a014b29430c7d2f5(size=71.8 M), total size for store is 409.7 M. This selection was in queue for 0sec, and took 23sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3688:2016-11-08 03:58:43,984 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=70.2 M, priority=0, time=729485448471209; duration=23sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3689:2016-11-08 03:58:43,984 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3690:2016-11-08 03:58:43,984 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 6 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=331.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3692:2016-11-08 03:58:46,335 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6476, memsize=153.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d7c4b3a2c97d4f568b76b3bddc3dd297 ./node-4/hbase-root-regionserver-node-4.cluster.log:3693:2016-11-08 03:58:50,052 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6476, memsize=285.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c6934a592809457290b1a42ee27974bf ./node-4/hbase-root-regionserver-node-4.cluster.log:3694:2016-11-08 03:58:50,924 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6476, memsize=80.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/23789d526db64efb839b8b16ada60af5 ./node-4/hbase-root-regionserver-node-4.cluster.log:3695:2016-11-08 03:58:50,968 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/d7c4b3a2c97d4f568b76b3bddc3dd297, entries=479047, sequenceid=6476, filesize=12.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3696:2016-11-08 03:58:51,001 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/c6934a592809457290b1a42ee27974bf, entries=1437141, sequenceid=6476, filesize=30.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3697:2016-11-08 03:58:51,007 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/23789d526db64efb839b8b16ada60af5, entries=479047, sequenceid=6476, filesize=12.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3698:2016-11-08 03:58:51,011 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~518.99 MB/544197392, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6588ms, sequenceid=6476, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3711:2016-11-08 03:59:03,579 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:3729:2016-11-08 03:59:09,454 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 5 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 289db71343c8405b88a34c94a687d62a(size=144.5 M), total size for store is 443.9 M. This selection was in queue for 0sec, and took 34sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3730:2016-11-08 03:59:09,454 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=5, fileSize=140.8 M, priority=-1, time=729500682716225; duration=34sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3731:2016-11-08 03:59:09,456 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3732:2016-11-08 03:59:09,456 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 10 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=181.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3758:2016-11-08 03:59:23,691 INFO [PriorityRpcServer.handler=4,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:3760:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:3770:2016-11-08 03:59:23,765 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=6, fileSize=331.7 M (102.0 M, 43.5 M, 49.3 M, 124.2 M, 7.4 M, 5.3 M), priority=1, time=729505668911553; duration=39sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3774:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:3784:2016-11-08 03:59:23,821 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3786:2016-11-08 03:59:23,821 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=10, fileSize=181.3 M (81.2 M, 15.5 M, 11.8 M, 7.1 M, 8.3 M, 14.4 M, 12.0 M, 18.6 M, 7.1 M, 5.2 M), priority=1, time=729505669134293; duration=14sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3789:2016-11-08 03:59:25,648 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6838, memsize=153.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1c7ffa5531b14ed4b11887a583f7be99 ./node-4/hbase-root-regionserver-node-4.cluster.log:3790:2016-11-08 03:59:29,523 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6838, memsize=285.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3fa0d6d1643b4f5aae1cea80f73fef4b ./node-4/hbase-root-regionserver-node-4.cluster.log:3791:2016-11-08 03:59:30,316 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6838, memsize=80.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2aedbf4f8dda492b908b7b0710a67914 ./node-4/hbase-root-regionserver-node-4.cluster.log:3792:2016-11-08 03:59:30,328 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/1c7ffa5531b14ed4b11887a583f7be99, entries=479383, sequenceid=6838, filesize=12.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3793:2016-11-08 03:59:30,334 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/3fa0d6d1643b4f5aae1cea80f73fef4b, entries=1438149, sequenceid=6838, filesize=30.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3794:2016-11-08 03:59:30,339 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/2aedbf4f8dda492b908b7b0710a67914, entries=479383, sequenceid=6838, filesize=12.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3795:2016-11-08 03:59:30,351 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Finished memstore flush of ~519.35 MB/544579088, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6530ms, sequenceid=6838, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:3796:2016-11-08 03:59:30,351 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:3797:2016-11-08 03:59:30,352 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:3798:2016-11-08 03:59:30,352 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:3799:2016-11-08 03:59:30,353 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:3800:2016-11-08 03:59:30,362 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3801:2016-11-08 03:59:30,371 INFO [PriorityRpcServer.handler=17,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3802:2016-11-08 03:59:30,408 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3803:2016-11-08 03:59:30,408 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3804:2016-11-08 03:59:30,447 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3805:2016-11-08 03:59:30,448 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3806:2016-11-08 03:59:30,485 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3807:2016-11-08 03:59:30,485 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3808:2016-11-08 03:59:30,486 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:3809:2016-11-08 03:59:30,486 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:3810:2016-11-08 03:59:30,579 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=6842 ./node-4/hbase-root-regionserver-node-4.cluster.log:3811:2016-11-08 03:59:30,591 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3812:2016-11-08 03:59:30,611 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:3826:2016-11-08 03:59:30,791 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3827:2016-11-08 03:59:30,791 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=24.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3892:2016-11-08 03:59:33,156 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 88b7f8fc1b994ace9083640d9c329cf6(size=19.4 M), total size for store is 200.5 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3893:2016-11-08 03:59:33,156 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=24.4 M, priority=-2, time=729556192662124; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:3894:2016-11-08 03:59:33,159 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:3895:2016-11-08 03:59:33,159 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=27.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:3969:2016-11-08 03:59:36,246 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1bc890c242a041fc9f2e17a0897ffdcc(size=27.3 M), total size for store is 200.7 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:3970:2016-11-08 03:59:36,246 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=27.1 M, priority=0, time=729558560643884; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4003:2016-11-08 03:59:42,318 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6937, memsize=38.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/83068d828c0541289d5480820afd44b2 ./node-4/hbase-root-regionserver-node-4.cluster.log:4004:2016-11-08 03:59:43,261 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6937, memsize=71.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/336a36f33ba2484bb4921df20ab21f72 ./node-4/hbase-root-regionserver-node-4.cluster.log:4005:2016-11-08 03:59:43,493 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=6937, memsize=20.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5ab8abb799b94973ba7708306a22f28e ./node-4/hbase-root-regionserver-node-4.cluster.log:4006:2016-11-08 03:59:43,502 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/83068d828c0541289d5480820afd44b2, entries=120676, sequenceid=6937, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4007:2016-11-08 03:59:43,522 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/336a36f33ba2484bb4921df20ab21f72, entries=362028, sequenceid=6937, filesize=7.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4008:2016-11-08 03:59:43,527 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/5ab8abb799b94973ba7708306a22f28e, entries=120676, sequenceid=6937, filesize=3.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4009:2016-11-08 03:59:43,528 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~130.74 MB/137087936, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2233ms, sequenceid=6937, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4027:2016-11-08 03:59:48,259 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7024, memsize=41.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6930dca769d4407184f34d3bbdd9d27b ./node-4/hbase-root-regionserver-node-4.cluster.log:4032:2016-11-08 03:59:49,848 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7024, memsize=76.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/fa6379c982b24fc78584d4e6d62b7d40 ./node-4/hbase-root-regionserver-node-4.cluster.log:4033:2016-11-08 03:59:50,160 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7024, memsize=21.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b2e4b8fad5064fa1b9082c385feeb960 ./node-4/hbase-root-regionserver-node-4.cluster.log:4034:2016-11-08 03:59:50,169 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/6930dca769d4407184f34d3bbdd9d27b, entries=129138, sequenceid=7024, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4035:2016-11-08 03:59:50,187 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/fa6379c982b24fc78584d4e6d62b7d40, entries=387414, sequenceid=7024, filesize=7.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4036:2016-11-08 03:59:50,211 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/b2e4b8fad5064fa1b9082c385feeb960, entries=129138, sequenceid=7024, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4037:2016-11-08 03:59:50,243 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~139.90 MB/146700768, currentsize=99.56 MB/104398400 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3096ms, sequenceid=7024, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4042:2016-11-08 03:59:52,150 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7107, memsize=40.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f87605e61591404a89ea07060b3a38f1 ./node-4/hbase-root-regionserver-node-4.cluster.log:4045:2016-11-08 03:59:53,096 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4046:2016-11-08 03:59:53,097 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=19.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4050:2016-11-08 03:59:54,158 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7107, memsize=75.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0308066bbcc24901afcd549410237788 ./node-4/hbase-root-regionserver-node-4.cluster.log:4058:2016-11-08 03:59:54,767 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7107, memsize=21.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2731c7aaa2834fd5b99c946259075c7c ./node-4/hbase-root-regionserver-node-4.cluster.log:4059:2016-11-08 03:59:54,796 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f87605e61591404a89ea07060b3a38f1, entries=127455, sequenceid=7107, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4060:2016-11-08 03:59:54,806 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/0308066bbcc24901afcd549410237788, entries=382365, sequenceid=7107, filesize=7.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4061:2016-11-08 03:59:54,842 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/2731c7aaa2834fd5b99c946259075c7c, entries=127455, sequenceid=7107, filesize=3.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4062:2016-11-08 03:59:54,872 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~138.08 MB/144788880, currentsize=120.03 MB/125858576 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3931ms, sequenceid=7107, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4078:2016-11-08 03:59:55,154 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4079:2016-11-08 03:59:55,155 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4080:2016-11-08 03:59:55,191 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4091:2016-11-08 03:59:57,883 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 90d16dba8c884840a22d666cf1b9ae83(size=7.1 M), total size for store is 207.7 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4092:2016-11-08 03:59:57,883 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=9.5 M, priority=-1, time=729580555751961; duration=2sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4093:2016-11-08 03:59:57,931 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4094:2016-11-08 03:59:57,931 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=21.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4113:2016-11-08 03:59:59,586 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 8d4bad4d21fe48e987abcd6de02a31f8(size=28.1 M), total size for store is 375.8 M. This selection was in queue for 0sec, and took 6sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4114:2016-11-08 03:59:59,586 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=19.3 M, priority=0, time=729578497830474; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4120:2016-11-08 04:00:00,440 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7227, memsize=59.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6eedff8171e74fa88fb1185a3d1695d1 ./node-4/hbase-root-regionserver-node-4.cluster.log:4121:2016-11-08 04:00:00,442 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4122:2016-11-08 04:00:00,442 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 9 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=207.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4124:2016-11-08 04:00:02,531 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7227, memsize=111.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4b1a8e6a4e1b44efbffe8068be8dd4f1 ./node-4/hbase-root-regionserver-node-4.cluster.log:4125:2016-11-08 04:00:03,187 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7227, memsize=31.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8a74a0691b274652a087ec293b1b3bf9 ./node-4/hbase-root-regionserver-node-4.cluster.log:4126:2016-11-08 04:00:03,206 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into eeca028929b643bbb083d719b8cb7c0d(size=18.8 M), total size for store is 493.5 M. This selection was in queue for 0sec, and took 5sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4127:2016-11-08 04:00:03,206 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=21.8 M, priority=0, time=729583332233663; duration=5sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4128:2016-11-08 04:00:03,212 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4129:2016-11-08 04:00:03,212 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 8 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=493.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4130:2016-11-08 04:00:03,245 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/6eedff8171e74fa88fb1185a3d1695d1, entries=186567, sequenceid=7227, filesize=4.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4131:2016-11-08 04:00:03,262 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/4b1a8e6a4e1b44efbffe8068be8dd4f1, entries=559701, sequenceid=7227, filesize=11.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4132:2016-11-08 04:00:03,273 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8a74a0691b274652a087ec293b1b3bf9, entries=186567, sequenceid=7227, filesize=4.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4133:2016-11-08 04:00:03,284 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~202.12 MB/211940112, currentsize=69.73 MB/73115232 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3593ms, sequenceid=7227, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4146:2016-11-08 04:00:05,938 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7319, memsize=39.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b940610acc904ca3bbbb23fc10d9855d ./node-4/hbase-root-regionserver-node-4.cluster.log:4148:2016-11-08 04:00:07,793 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7319, memsize=72.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/fd515dbc5ca149679ee0632921b4b6df ./node-4/hbase-root-regionserver-node-4.cluster.log:4149:2016-11-08 04:00:08,310 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7319, memsize=20.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/bfd660aeb08f41439f3abb7de49e5b10 ./node-4/hbase-root-regionserver-node-4.cluster.log:4150:2016-11-08 04:00:08,323 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/b940610acc904ca3bbbb23fc10d9855d, entries=121630, sequenceid=7319, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4151:2016-11-08 04:00:08,408 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/fd515dbc5ca149679ee0632921b4b6df, entries=364890, sequenceid=7319, filesize=7.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4152:2016-11-08 04:00:08,440 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/bfd660aeb08f41439f3abb7de49e5b10, entries=121630, sequenceid=7319, filesize=3.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4153:2016-11-08 04:00:08,445 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~131.77 MB/138171680, currentsize=139.19 MB/145948736 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3626ms, sequenceid=7319, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4154:2016-11-08 04:00:08,484 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4171:2016-11-08 04:00:42,852 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 9 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 09f86ede1e8a4ed9a84115439b9cafde(size=212.9 M), total size for store is 220.7 M. This selection was in queue for 0sec, and took 42sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4172:2016-11-08 04:00:42,853 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=207.7 M, priority=2, time=729585843468936; duration=42sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4173:2016-11-08 04:00:42,856 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4174:2016-11-08 04:00:42,856 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=11.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4175:2016-11-08 04:00:44,342 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6f0405859efd41fb99726dee2c54c878(size=16.1 M), total size for store is 388.7 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4176:2016-11-08 04:00:44,342 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=11.1 M, priority=-1, time=729628257777008; duration=1sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4177:2016-11-08 04:00:44,347 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4178:2016-11-08 04:00:44,347 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 9 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=388.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4180:2016-11-08 04:00:46,635 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7916, memsize=152.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5b7d840b95ec492b9893c6ea78000475 ./node-4/hbase-root-regionserver-node-4.cluster.log:4181:2016-11-08 04:00:50,041 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7916, memsize=283.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/90c34660d1b342a280bcfac31c100732 ./node-4/hbase-root-regionserver-node-4.cluster.log:4182:2016-11-08 04:00:50,584 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7916, memsize=79.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3906ef9e8e3040b98c0f1a437e87e383 ./node-4/hbase-root-regionserver-node-4.cluster.log:4183:2016-11-08 04:00:50,591 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5b7d840b95ec492b9893c6ea78000475, entries=476052, sequenceid=7916, filesize=12.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4184:2016-11-08 04:00:50,595 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/90c34660d1b342a280bcfac31c100732, entries=1428156, sequenceid=7916, filesize=30.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4185:2016-11-08 04:00:50,610 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/3906ef9e8e3040b98c0f1a437e87e383, entries=476052, sequenceid=7916, filesize=12.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4186:2016-11-08 04:00:50,615 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~515.74 MB/540795072, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5752ms, sequenceid=7916, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4187:2016-11-08 04:00:52,199 INFO [PriorityRpcServer.handler=3,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:4189:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4199:2016-11-08 04:00:52,240 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=9, fileSize=388.7 M (102.0 M, 43.5 M, 49.3 M, 124.2 M, 7.4 M, 5.3 M, 12.8 M, 28.1 M, 16.1 M), priority=2, time=729629748527673; duration=7sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4203:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4213:2016-11-08 04:00:52,400 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=8, fileSize=493.5 M (90.2 M, 76.7 M, 30.3 M, 71.8 M, 144.5 M, 30.5 M, 30.8 M, 18.8 M), priority=2, time=729588613101017; duration=49sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4217:2016-11-08 04:00:52,485 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7923, memsize=1.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5d2fb5493afa4dde8633b8a2826b16b3 ./node-4/hbase-root-regionserver-node-4.cluster.log:4218:2016-11-08 04:00:52,563 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7923, memsize=2.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/860d3c185c394ed48eec392ed1c37938 ./node-4/hbase-root-regionserver-node-4.cluster.log:4219:2016-11-08 04:00:52,649 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=7923, memsize=834.6 K, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/491348772936430eb798dea7687eb614 ./node-4/hbase-root-regionserver-node-4.cluster.log:4220:2016-11-08 04:00:52,661 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5d2fb5493afa4dde8633b8a2826b16b3, entries=4856, sequenceid=7923, filesize=101.7 K ./node-4/hbase-root-regionserver-node-4.cluster.log:4221:2016-11-08 04:00:52,706 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/860d3c185c394ed48eec392ed1c37938, entries=14568, sequenceid=7923, filesize=281.9 K ./node-4/hbase-root-regionserver-node-4.cluster.log:4222:2016-11-08 04:00:52,725 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/491348772936430eb798dea7687eb614, entries=4856, sequenceid=7923, filesize=132.9 K ./node-4/hbase-root-regionserver-node-4.cluster.log:4223:2016-11-08 04:00:52,730 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Finished memstore flush of ~5.26 MB/5516416, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 323ms, sequenceid=7923, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4224:2016-11-08 04:00:52,730 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:4225:2016-11-08 04:00:52,731 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:4226:2016-11-08 04:00:52,731 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:4227:2016-11-08 04:00:52,733 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:4228:2016-11-08 04:00:52,739 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4229:2016-11-08 04:00:52,747 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4230:2016-11-08 04:00:52,753 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4231:2016-11-08 04:00:52,753 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4243:2016-11-08 04:00:52,817 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4244:2016-11-08 04:00:52,818 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4245:2016-11-08 04:00:52,872 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4246:2016-11-08 04:00:52,872 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4247:2016-11-08 04:00:52,873 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4248:2016-11-08 04:00:52,873 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4254:2016-11-08 04:00:53,024 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=7927 ./node-4/hbase-root-regionserver-node-4.cluster.log:4255:2016-11-08 04:00:53,031 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4256:2016-11-08 04:00:53,159 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:4270:2016-11-08 04:00:53,313 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4271:2016-11-08 04:00:53,313 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=36.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4286:2016-11-08 04:00:54,098 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4287:2016-11-08 04:00:54,098 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=25.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4345:2016-11-08 04:00:57,989 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 0cd9feb6e01d4de987950fccd3ecc35f(size=36.1 M), total size for store is 412.2 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4346:2016-11-08 04:00:57,989 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=25.5 M, priority=-1, time=729639499588514; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4355:2016-11-08 04:00:59,010 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4358:2016-11-08 04:00:59,052 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4359:2016-11-08 04:00:59,052 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 9 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=412.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4373:2016-11-08 04:01:03,925 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 0ab0ff1f8e8844b1bd6444c4f8c69de1(size=35.1 M), total size for store is 540.8 M. This selection was in queue for 0sec, and took 10sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4374:2016-11-08 04:01:03,925 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=36.9 M, priority=-2, time=729638714676397; duration=10sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4375:2016-11-08 04:01:03,959 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4376:2016-11-08 04:01:03,959 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=66.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4378:2016-11-08 04:01:06,074 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8189, memsize=106.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2963f83dbb5244178b4db42957ecccb0 ./node-4/hbase-root-regionserver-node-4.cluster.log:4392:2016-11-08 04:01:11,639 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8189, memsize=196.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3ca1141a0a5c4bfdb977622fe826af9a ./node-4/hbase-root-regionserver-node-4.cluster.log:4393:2016-11-08 04:01:12,381 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8189, memsize=55.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ed80b3a2d3d74a368f1bfe75fbd7c2b1 ./node-4/hbase-root-regionserver-node-4.cluster.log:4394:2016-11-08 04:01:12,417 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/2963f83dbb5244178b4db42957ecccb0, entries=330649, sequenceid=8189, filesize=8.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4395:2016-11-08 04:01:12,428 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/3ca1141a0a5c4bfdb977622fe826af9a, entries=991947, sequenceid=8189, filesize=20.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4396:2016-11-08 04:01:12,540 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/ed80b3a2d3d74a368f1bfe75fbd7c2b1, entries=330649, sequenceid=8189, filesize=7.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4397:2016-11-08 04:01:12,551 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~358.22 MB/375617264, currentsize=157.22 MB/164855184 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 8125ms, sequenceid=8189, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4398:2016-11-08 04:01:12,883 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4416:2016-11-08 04:01:27,630 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 2f3275819c5b404988766230c9ea7612(size=61.0 M), total size for store is 556.2 M. This selection was in queue for 0sec, and took 23sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4417:2016-11-08 04:01:27,630 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=66.1 M, priority=0, time=729649360369878; duration=23sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4427:2016-11-08 04:01:28,896 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4428:2016-11-08 04:01:28,896 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=556.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4429:2016-11-08 04:01:29,740 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8616, memsize=151.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8ace8e6b33dc4218a4480dc62776a25a ./node-4/hbase-root-regionserver-node-4.cluster.log:4435:2016-11-08 04:01:33,544 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8616, memsize=281.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a9c4effc8f5a4f49b8b9f28a8e125680 ./node-4/hbase-root-regionserver-node-4.cluster.log:4436:2016-11-08 04:01:34,147 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8616, memsize=79.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7328550386964397a2f448ea754abdf1 ./node-4/hbase-root-regionserver-node-4.cluster.log:4437:2016-11-08 04:01:34,160 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/8ace8e6b33dc4218a4480dc62776a25a, entries=472683, sequenceid=8616, filesize=12.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4438:2016-11-08 04:01:34,165 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/a9c4effc8f5a4f49b8b9f28a8e125680, entries=1418049, sequenceid=8616, filesize=30.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4439:2016-11-08 04:01:34,173 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/7328550386964397a2f448ea754abdf1, entries=472683, sequenceid=8616, filesize=11.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4440:2016-11-08 04:01:34,173 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~512.09 MB/536967888, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5846ms, sequenceid=8616, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4444:2016-11-08 04:01:39,783 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4447:2016-11-08 04:01:41,247 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8707, memsize=44.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b21226e0fc1a47608effe48e8f4ecba4 ./node-4/hbase-root-regionserver-node-4.cluster.log:4448:2016-11-08 04:01:42,945 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8707, memsize=81.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c7982b9c51dd411fb0c199988a6fda3f ./node-4/hbase-root-regionserver-node-4.cluster.log:4449:2016-11-08 04:01:43,395 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=8707, memsize=23.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/689ada3266f740f4b769aa0f14a1e755 ./node-4/hbase-root-regionserver-node-4.cluster.log:4450:2016-11-08 04:01:43,428 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/b21226e0fc1a47608effe48e8f4ecba4, entries=137650, sequenceid=8707, filesize=2.8 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4451:2016-11-08 04:01:43,455 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/c7982b9c51dd411fb0c199988a6fda3f, entries=412950, sequenceid=8707, filesize=7.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4452:2016-11-08 04:01:43,461 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/689ada3266f740f4b769aa0f14a1e755, entries=137650, sequenceid=8707, filesize=3.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4453:2016-11-08 04:01:43,499 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool13-thread-1] regionserver.HRegion: Finished memstore flush of ~149.13 MB/156370400, currentsize=74.95 MB/78590752 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 2926ms, sequenceid=8707, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4484:2016-11-08 04:01:57,267 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 9 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into be353d36659f47a3b74dba15817c8400(size=417.5 M), total size for store is 440.5 M. This selection was in queue for 0sec, and took 58sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4485:2016-11-08 04:01:57,268 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=9, fileSize=412.2 M, priority=2, time=729644452966130; duration=58sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4495:2016-11-08 04:02:07,672 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:4497:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4507:2016-11-08 04:02:08,103 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4509:2016-11-08 04:02:08,103 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=556.2 M (90.2 M, 76.7 M, 30.3 M, 71.8 M, 144.5 M, 30.5 M, 30.8 M, 61.0 M, 20.5 M), priority=2, time=729674297697407; duration=39sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4520:2016-11-08 04:02:09,558 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9145, memsize=151.9 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/abb7bb029041425899e7397c939d7442 ./node-4/hbase-root-regionserver-node-4.cluster.log:4527:2016-11-08 04:02:13,971 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9145, memsize=282.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6b3a51725c27405b981661a3cc56edc6 ./node-4/hbase-root-regionserver-node-4.cluster.log:4528:2016-11-08 04:02:15,109 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9145, memsize=79.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6249e50bb5d74e858318e2975dbbd625 ./node-4/hbase-root-regionserver-node-4.cluster.log:4529:2016-11-08 04:02:15,172 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/abb7bb029041425899e7397c939d7442, entries=474038, sequenceid=9145, filesize=12.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4530:2016-11-08 04:02:15,188 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6b3a51725c27405b981661a3cc56edc6, entries=1422114, sequenceid=9145, filesize=30.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4531:2016-11-08 04:02:15,196 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/6249e50bb5d74e858318e2975dbbd625, entries=474038, sequenceid=9145, filesize=11.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4532:2016-11-08 04:02:15,207 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Finished memstore flush of ~513.56 MB/538507168, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7104ms, sequenceid=9145, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4533:2016-11-08 04:02:15,207 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:4534:2016-11-08 04:02:15,209 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:4535:2016-11-08 04:02:15,209 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:4536:2016-11-08 04:02:15,211 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:4537:2016-11-08 04:02:15,218 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4538:2016-11-08 04:02:15,235 INFO [PriorityRpcServer.handler=9,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4539:2016-11-08 04:02:15,251 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4540:2016-11-08 04:02:15,251 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4541:2016-11-08 04:02:15,375 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4542:2016-11-08 04:02:15,375 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4543:2016-11-08 04:02:15,662 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4544:2016-11-08 04:02:15,662 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4545:2016-11-08 04:02:15,663 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4546:2016-11-08 04:02:15,664 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4552:2016-11-08 04:02:16,100 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=9149 ./node-4/hbase-root-regionserver-node-4.cluster.log:4553:2016-11-08 04:02:16,118 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4554:2016-11-08 04:02:16,156 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4555:2016-11-08 04:02:16,156 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=58.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4556:2016-11-08 04:02:16,171 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:4572:2016-11-08 04:02:16,705 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4573:2016-11-08 04:02:16,705 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 8 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=53.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4608:2016-11-08 04:02:22,156 INFO [PriorityRpcServer.handler=4,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:4610:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4620:2016-11-08 04:02:22,342 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=58.5 M (20.5 M, 30.2 M, 7.9 M), priority=-2, time=729721557359384; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4624:java.io.InterruptedIOException: Aborting compaction of store tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4634:2016-11-08 04:02:22,812 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=8, fileSize=53.7 M (4.7 M, 3.1 M, 12.0 M, 132.9 K, 7.9 M, 11.3 M, 3.3 M, 11.3 M), priority=2, time=729722105924763; duration=6sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4637:2016-11-08 04:02:22,816 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:4638:2016-11-08 04:02:22,817 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:4639:2016-11-08 04:02:22,817 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:4640:2016-11-08 04:02:22,817 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:4641:2016-11-08 04:02:22,826 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4642:2016-11-08 04:02:22,835 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4643:2016-11-08 04:02:22,869 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4644:2016-11-08 04:02:22,869 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4645:2016-11-08 04:02:22,971 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4646:2016-11-08 04:02:22,971 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4647:2016-11-08 04:02:23,187 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4648:2016-11-08 04:02:23,188 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4649:2016-11-08 04:02:23,191 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4650:2016-11-08 04:02:23,191 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4656:2016-11-08 04:02:23,381 INFO [RS_OPEN_REGION-node-4:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=9152 ./node-4/hbase-root-regionserver-node-4.cluster.log:4657:2016-11-08 04:02:23,395 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4658:2016-11-08 04:02:23,415 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:4672:2016-11-08 04:02:23,875 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4673:2016-11-08 04:02:23,876 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=58.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4690:2016-11-08 04:02:24,075 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4691:2016-11-08 04:02:24,075 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 8 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=53.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4717:2016-11-08 04:02:27,503 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4738:2016-11-08 04:02:41,819 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6536669f816741c2b6dad5a7ce1ac6a0(size=48.5 M), total size for store is 614.5 M. This selection was in queue for 0sec, and took 17sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4739:2016-11-08 04:02:41,819 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=58.5 M, priority=-2, time=729729276870913; duration=17sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4743:2016-11-08 04:02:42,656 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 8 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 955c307ea2824c2d8b4db4804d86ad9d(size=56.4 M), total size for store is 269.2 M. This selection was in queue for 0sec, and took 18sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4744:2016-11-08 04:02:42,657 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=8, fileSize=53.7 M, priority=2, time=729729476188333; duration=18sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4745:2016-11-08 04:02:42,670 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4746:2016-11-08 04:02:42,670 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=122.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4747:2016-11-08 04:02:44,499 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9566, memsize=155.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c5dfb2c502924042ba39c132608f49ba ./node-4/hbase-root-regionserver-node-4.cluster.log:4752:2016-11-08 04:02:48,755 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9566, memsize=288.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b029d51697ae42f4996c941b65b7a6a2 ./node-4/hbase-root-regionserver-node-4.cluster.log:4753:2016-11-08 04:02:50,128 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9566, memsize=81.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1d8d046af4fe47c4a4083f686419d35c ./node-4/hbase-root-regionserver-node-4.cluster.log:4754:2016-11-08 04:02:50,157 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/c5dfb2c502924042ba39c132608f49ba, entries=484438, sequenceid=9566, filesize=15.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4755:2016-11-08 04:02:50,162 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/b029d51697ae42f4996c941b65b7a6a2, entries=1453314, sequenceid=9566, filesize=30.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4756:2016-11-08 04:02:50,167 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/1d8d046af4fe47c4a4083f686419d35c, entries=484438, sequenceid=9566, filesize=14.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4757:2016-11-08 04:02:50,175 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~524.83 MB/550321568, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 8208ms, sequenceid=9566, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4758:2016-11-08 04:03:00,509 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4781:2016-11-08 04:03:08,549 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into fa5209c0c731409fb2c9d4aa91ad7220(size=113.4 M), total size for store is 636.0 M. This selection was in queue for 0sec, and took 25sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4782:2016-11-08 04:03:08,549 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=122.3 M, priority=0, time=729748071375287; duration=25sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4783:2016-11-08 04:03:08,576 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4784:2016-11-08 04:03:08,576 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 9 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=636.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4793:2016-11-08 04:03:13,499 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9942, memsize=128.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ee59dead94d84ecfa8949c8ce054195d ./node-4/hbase-root-regionserver-node-4.cluster.log:4794:2016-11-08 04:03:17,391 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9942, memsize=238.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/fb3ccda597e145a6a4f8f3c389f39214 ./node-4/hbase-root-regionserver-node-4.cluster.log:4795:2016-11-08 04:03:18,685 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=9942, memsize=67.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4ddee34217224523be3d59935218360d ./node-4/hbase-root-regionserver-node-4.cluster.log:4796:2016-11-08 04:03:18,808 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ee59dead94d84ecfa8949c8ce054195d, entries=400475, sequenceid=9942, filesize=12.6 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4797:2016-11-08 04:03:18,832 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/fb3ccda597e145a6a4f8f3c389f39214, entries=1201425, sequenceid=9942, filesize=25.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4798:2016-11-08 04:03:18,879 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/4ddee34217224523be3d59935218360d, entries=400475, sequenceid=9942, filesize=12.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4799:2016-11-08 04:03:18,883 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~433.86 MB/454939600, currentsize=82.69 MB/86710880 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 9772ms, sequenceid=9942, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4802:2016-11-08 04:03:23,538 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10028, memsize=38.7 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/03ae213aa2fc41a088c56a2d3890b5ec ./node-4/hbase-root-regionserver-node-4.cluster.log:4807:2016-11-08 04:03:25,659 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10028, memsize=71.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/42f03f341c794d1496081c24ccbac7dd ./node-4/hbase-root-regionserver-node-4.cluster.log:4810:2016-11-08 04:03:26,187 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10028, memsize=20.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d66f75693bdb4e81bf30b2a2764c9be4 ./node-4/hbase-root-regionserver-node-4.cluster.log:4811:2016-11-08 04:03:26,220 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/03ae213aa2fc41a088c56a2d3890b5ec, entries=120800, sequenceid=10028, filesize=3.7 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4812:2016-11-08 04:03:26,268 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/42f03f341c794d1496081c24ccbac7dd, entries=362400, sequenceid=10028, filesize=7.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4813:2016-11-08 04:03:26,312 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/d66f75693bdb4e81bf30b2a2764c9be4, entries=120800, sequenceid=10028, filesize=3.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4814:2016-11-08 04:03:26,339 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~130.87 MB/137228800, currentsize=144.51 MB/151533312 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3906ms, sequenceid=10028, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4815:2016-11-08 04:03:26,346 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4845:2016-11-08 04:03:43,531 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10449, memsize=152.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/643fc915842c44ec868b4794bd58de46 ./node-4/hbase-root-regionserver-node-4.cluster.log:4846:2016-11-08 04:03:47,819 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10449, memsize=282.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/887ab63b39b94a5c8a9b7d5f17680955 ./node-4/hbase-root-regionserver-node-4.cluster.log:4849:2016-11-08 04:03:48,907 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4850:2016-11-08 04:03:48,907 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 7 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=66.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4851:2016-11-08 04:03:49,840 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10449, memsize=79.7 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0f27889b1dc74e1dbf8a2cc0b83c67d0 ./node-4/hbase-root-regionserver-node-4.cluster.log:4852:2016-11-08 04:03:49,880 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/643fc915842c44ec868b4794bd58de46, entries=474917, sequenceid=10449, filesize=15.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4853:2016-11-08 04:03:49,956 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/887ab63b39b94a5c8a9b7d5f17680955, entries=1424751, sequenceid=10449, filesize=29.9 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4854:2016-11-08 04:03:49,976 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/0f27889b1dc74e1dbf8a2cc0b83c67d0, entries=474917, sequenceid=10449, filesize=14.3 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4855:2016-11-08 04:03:49,983 INFO [rs(node-4.cluster,16020,1478575564466)-flush-proc-pool14-thread-1] regionserver.HRegion: Finished memstore flush of ~514.51 MB/539505712, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 9566ms, sequenceid=10449, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:4867:2016-11-08 04:03:51,751 INFO [PriorityRpcServer.handler=8,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:4869:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4879:2016-11-08 04:03:51,984 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=7, fileSize=66.5 M (8.2 M, 12.0 M, 2.8 M, 12.0 M, 15.3 M, 12.6 M, 3.7 M), priority=2, time=729814308694694; duration=3sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4883:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:4893:2016-11-08 04:03:52,307 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=9, fileSize=636.0 M (90.2 M, 76.7 M, 30.3 M, 71.8 M, 144.5 M, 113.4 M, 48.5 M, 30.2 M, 30.5 M), priority=2, time=729773977190395; duration=43sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4896:2016-11-08 04:03:52,311 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:4897:2016-11-08 04:03:52,315 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:4898:2016-11-08 04:03:52,315 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:4899:2016-11-08 04:03:52,319 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:4900:2016-11-08 04:03:52,340 INFO [RS_CLOSE_REGION-node-4:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4901:2016-11-08 04:03:52,355 INFO [PriorityRpcServer.handler=10,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4902:2016-11-08 04:03:52,385 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4903:2016-11-08 04:03:52,385 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4904:2016-11-08 04:03:52,635 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4905:2016-11-08 04:03:52,636 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4906:2016-11-08 04:03:52,912 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4907:2016-11-08 04:03:52,912 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4908:2016-11-08 04:03:52,919 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4909:2016-11-08 04:03:52,919 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4910:2016-11-08 04:03:52,922 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:4911:2016-11-08 04:03:52,922 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:4913:2016-11-08 04:03:53,088 INFO [RS_OPEN_REGION-node-4:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=10453 ./node-4/hbase-root-regionserver-node-4.cluster.log:4914:2016-11-08 04:03:53,103 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4915:2016-11-08 04:03:53,135 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478575564466 ./node-4/hbase-root-regionserver-node-4.cluster.log:4929:2016-11-08 04:03:53,406 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4930:2016-11-08 04:03:53,406 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=63.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4943:2016-11-08 04:03:53,565 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4944:2016-11-08 04:03:53,565 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Starting compaction of 8 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=81.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4971:2016-11-08 04:04:01,989 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:4985:2016-11-08 04:04:07,097 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 698837c3222943f6967a807b9a1a4ee5(size=52.0 M), total size for store is 687.4 M. This selection was in queue for 0sec, and took 13sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:4986:2016-11-08 04:04:07,098 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=63.0 M, priority=-2, time=729818807123011; duration=13sec ./node-4/hbase-root-regionserver-node-4.cluster.log:4987:2016-11-08 04:04:07,100 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:4988:2016-11-08 04:04:07,100 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=112.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:4996:2016-11-08 04:04:12,444 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10680, memsize=105.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/169f2161456f409a9088602b677a814d ./node-4/hbase-root-regionserver-node-4.cluster.log:5004:2016-11-08 04:04:17,591 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10680, memsize=195.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/b3bb9864bc174100a0d0499e51522cdc ./node-4/hbase-root-regionserver-node-4.cluster.log:5005:2016-11-08 04:04:18,758 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10680, memsize=55.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c0b4da08c0b1448b851ec685e826e9c4 ./node-4/hbase-root-regionserver-node-4.cluster.log:5006:2016-11-08 04:04:18,815 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/169f2161456f409a9088602b677a814d, entries=328583, sequenceid=10680, filesize=10.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5007:2016-11-08 04:04:18,828 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/b3bb9864bc174100a0d0499e51522cdc, entries=985749, sequenceid=10680, filesize=20.5 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5008:2016-11-08 04:04:18,833 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/c0b4da08c0b1448b851ec685e826e9c4, entries=328583, sequenceid=10680, filesize=9.1 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5009:2016-11-08 04:04:18,836 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~355.98 MB/373270288, currentsize=163.30 MB/171228144 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 11103ms, sequenceid=10680, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:5010:2016-11-08 04:04:18,926 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-4/hbase-root-regionserver-node-4.cluster.log:5011:2016-11-08 04:04:20,545 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.HStore: Completed compaction of 8 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into aa2e9f26f72d4718889408de851a4710(size=126.6 M), total size for store is 554.2 M. This selection was in queue for 0sec, and took 26sec to execute. ./node-4/hbase-root-regionserver-node-4.cluster.log:5012:2016-11-08 04:04:20,545 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478575566259] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=8, fileSize=81.5 M, priority=2, time=729818966308518; duration=26sec ./node-4/hbase-root-regionserver-node-4.cluster.log:5039:2016-11-08 04:04:37,915 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to node-5.cluster,16020,1478577464990 ./node-4/hbase-root-regionserver-node-4.cluster.log:5041:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-4/hbase-root-regionserver-node-4.cluster.log:5051:2016-11-08 04:04:38,054 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478577079144] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=112.1 M (30.2 M, 52.0 M, 29.9 M), priority=0, time=729832501547551; duration=30sec ./node-4/hbase-root-regionserver-node-4.cluster.log:5052:2016-11-08 04:04:38,055 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:5057:2016-11-08 04:04:40,591 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10981, memsize=154.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3a04ec6db518441d99d68c220c61f192 ./node-4/hbase-root-regionserver-node-4.cluster.log:5099:2016-11-08 04:04:44,415 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10981, memsize=286.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/da0e77078d314539bf679e1e1ade1b8f ./node-4/hbase-root-regionserver-node-4.cluster.log:5100:2016-11-08 04:04:45,867 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=10981, memsize=80.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2ca6625268b94c9eb4b772b94529151b ./node-4/hbase-root-regionserver-node-4.cluster.log:5101:2016-11-08 04:04:45,892 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/3a04ec6db518441d99d68c220c61f192, entries=481411, sequenceid=10981, filesize=15.0 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5102:2016-11-08 04:04:45,898 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/da0e77078d314539bf679e1e1ade1b8f, entries=1444233, sequenceid=10981, filesize=30.2 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5103:2016-11-08 04:04:45,935 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/2ca6625268b94c9eb4b772b94529151b, entries=481411, sequenceid=10981, filesize=14.4 M ./node-4/hbase-root-regionserver-node-4.cluster.log:5104:2016-11-08 04:04:45,947 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Finished memstore flush of ~521.55 MB/546882896, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7892ms, sequenceid=10981, compaction requested=true ./node-4/hbase-root-regionserver-node-4.cluster.log:5105:2016-11-08 04:04:45,971 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:5106:2016-11-08 04:04:45,975 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:5107:2016-11-08 04:04:45,975 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-4/hbase-root-regionserver-node-4.cluster.log:5108:2016-11-08 04:04:45,975 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-4/hbase-root-regionserver-node-4.cluster.log:5109:2016-11-08 04:04:45,976 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:5110:2016-11-08 04:04:46,012 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:5111:2016-11-08 04:04:46,012 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegionServer: Adding moved region record: 393d2bfd8b1c52ce08540306659624f2 to node-5.cluster,16020,1478577464990 as of 10981 ./node-4/hbase-root-regionserver-node-4.cluster.log:7232:2016-11-08 04:37:07,286 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7233:2016-11-08 04:37:07,286 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7234:2016-11-08 04:37:07,288 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7235:2016-11-08 04:37:07,288 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7248:2016-11-08 04:37:07,433 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7249:2016-11-08 04:37:07,433 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7262:2016-11-08 04:37:07,598 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7263:2016-11-08 04:37:07,598 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7264:2016-11-08 04:37:07,599 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7265:2016-11-08 04:37:07,599 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7266:2016-11-08 04:37:07,601 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15461920, freeSize=12823250400, maxSize=12838712320, heapSize=15461920, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:7267:2016-11-08 04:37:07,601 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:7355:2016-11-08 04:39:43,041 INFO [StoreFileOpenerThread-meta-1] regionserver.StoreFile: Bloom filter turned off by CF config for 7ec91e98f080464fa58e8bd17e5c5bbc.393d2bfd8b1c52ce08540306659624f2 ./node-4/hbase-root-regionserver-node-4.cluster.log:7359:2016-11-08 04:39:43,056 INFO [StoreFileOpenerThread-meta-1] regionserver.StoreFile: Bloom filter turned off by CF config for ab66df267f27474ba1f32a244117757c.393d2bfd8b1c52ce08540306659624f2 ./node-4/hbase-root-regionserver-node-4.cluster.log:7368:2016-11-08 04:39:43,085 INFO [StoreFileOpenerThread-tiny-1] regionserver.StoreFile: HFile Bloom filter type for 08241caa0a35450ca7ff92ae907b242c.393d2bfd8b1c52ce08540306659624f2: NONE, but ROWCOL specified in column family configuration ./node-4/hbase-root-regionserver-node-4.cluster.log:7423:2016-11-08 04:39:51,995 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478578943465] regionserver.StoreFile: Bloom filter turned off by CF config for ab66df267f27474ba1f32a244117757c.393d2bfd8b1c52ce08540306659624f2 ./node-4/hbase-root-regionserver-node-4.cluster.log:7424:2016-11-08 04:39:51,999 INFO [regionserver/node-4.cluster/192.168.124.5:16020-longCompactions-1478578841071] regionserver.StoreFile: HFile Bloom filter type for 08241caa0a35450ca7ff92ae907b242c.393d2bfd8b1c52ce08540306659624f2: NONE, but ROWCOL specified in column family configuration ./node-4/hbase-root-regionserver-node-4.cluster.log:7425:2016-11-08 04:39:52,009 INFO [regionserver/node-4.cluster/192.168.124.5:16020-shortCompactions-1478578943465] regionserver.StoreFile: Bloom filter turned off by CF config for 7ec91e98f080464fa58e8bd17e5c5bbc.393d2bfd8b1c52ce08540306659624f2 ./node-4/hbase-root-regionserver-node-4.cluster.log:9808:2016-11-08 05:07:34,516 INFO [PriorityRpcServer.handler=0,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9811:2016-11-08 05:07:34,613 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9812:2016-11-08 05:07:34,620 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9819:2016-11-08 05:07:34,687 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9820:2016-11-08 05:07:34,687 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9825:2016-11-08 05:07:34,711 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9826:2016-11-08 05:07:34,711 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9829:2016-11-08 05:07:34,729 INFO [RS_OPEN_REGION-node-4:16020-0] regionserver.HRegion: Replaying edits from hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000019211 ./node-4/hbase-root-regionserver-node-4.cluster.log:9836:2016-11-08 05:07:34,769 INFO [RS_OPEN_REGION-node-4:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19212 ./node-4/hbase-root-regionserver-node-4.cluster.log:9839:2016-11-08 05:07:34,784 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9843:2016-11-08 05:07:34,867 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478581638184 ./node-4/hbase-root-regionserver-node-4.cluster.log:9850:2016-11-08 05:08:08,303 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:9851:2016-11-08 05:08:08,321 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:9852:2016-11-08 05:08:08,322 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:9853:2016-11-08 05:08:08,323 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:9854:2016-11-08 05:08:08,334 INFO [RS_CLOSE_REGION-node-4:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9855:2016-11-08 05:08:08,339 INFO [PriorityRpcServer.handler=4,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9856:2016-11-08 05:08:08,348 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9857:2016-11-08 05:08:08,348 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9859:2016-11-08 05:08:08,358 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9860:2016-11-08 05:08:08,358 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9861:2016-11-08 05:08:08,367 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9862:2016-11-08 05:08:08,367 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9863:2016-11-08 05:08:08,382 INFO [RS_OPEN_REGION-node-4:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19215 ./node-4/hbase-root-regionserver-node-4.cluster.log:9864:2016-11-08 05:08:08,385 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9865:2016-11-08 05:08:08,389 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478581638184 ./node-4/hbase-root-regionserver-node-4.cluster.log:9894:2016-11-08 05:08:17,345 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:9895:2016-11-08 05:08:17,348 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:9896:2016-11-08 05:08:17,349 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-4/hbase-root-regionserver-node-4.cluster.log:9897:2016-11-08 05:08:17,350 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-4/hbase-root-regionserver-node-4.cluster.log:9898:2016-11-08 05:08:17,358 INFO [RS_CLOSE_REGION-node-4:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9979:2016-11-08 05:12:11,906 INFO [PriorityRpcServer.handler=13,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9980:2016-11-08 05:12:11,916 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=5, currentSize=13824888, freeSize=12824887432, maxSize=12838712320, heapSize=13824888, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9981:2016-11-08 05:12:11,916 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9983:2016-11-08 05:12:11,922 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=5, currentSize=13824888, freeSize=12824887432, maxSize=12838712320, heapSize=13824888, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9984:2016-11-08 05:12:11,923 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9985:2016-11-08 05:12:11,930 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=5, currentSize=13824888, freeSize=12824887432, maxSize=12838712320, heapSize=13824888, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-4/hbase-root-regionserver-node-4.cluster.log:9986:2016-11-08 05:12:11,930 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-4/hbase-root-regionserver-node-4.cluster.log:9987:2016-11-08 05:12:11,944 INFO [RS_OPEN_REGION-node-4:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19219 ./node-4/hbase-root-regionserver-node-4.cluster.log:9988:2016-11-08 05:12:11,946 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9989:2016-11-08 05:12:12,097 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-4.cluster,16020,1478581638184 ./node-4/hbase-root-regionserver-node-4.cluster.log:9992:2016-11-08 05:12:17,232 INFO [PriorityRpcServer.handler=15,queue=1,port=16020] regionserver.RSRpcServices: Flushing IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-4/hbase-root-regionserver-node-4.cluster.log:9997:2016-11-08 05:12:38,133 INFO [PriorityRpcServer.handler=12,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-4/hbase-root-regionserver-node-4.cluster.log:9998:2016-11-08 05:12:38,135 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-4/hbase-root-regionserver-node-4.cluster.log:9999:2016-11-08 05:12:38,136 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:10078:2016-11-08 05:07:34,244 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000019189.temp to hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/recovered.edits/0000000000000019211 ./node-5/hbase-root-regionserver-node-5.cluster.log:10526:2016-11-08 05:15:01,145 INFO [PriorityRpcServer.handler=13,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10529:2016-11-08 05:15:01,165 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10530:2016-11-08 05:15:01,165 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10533:2016-11-08 05:15:01,188 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10534:2016-11-08 05:15:01,189 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10535:2016-11-08 05:15:01,203 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10536:2016-11-08 05:15:01,204 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10538:2016-11-08 05:15:01,242 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19225 ./node-5/hbase-root-regionserver-node-5.cluster.log:10539:2016-11-08 05:15:01,245 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10540:2016-11-08 05:15:01,248 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478582087459 ./node-5/hbase-root-regionserver-node-5.cluster.log:10552:2016-11-08 05:15:38,124 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:10553:2016-11-08 05:15:38,130 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:10554:2016-11-08 05:15:38,132 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:10555:2016-11-08 05:15:38,134 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:10556:2016-11-08 05:15:38,145 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10557:2016-11-08 05:15:38,149 INFO [PriorityRpcServer.handler=8,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10558:2016-11-08 05:15:38,158 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10559:2016-11-08 05:15:38,158 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10561:2016-11-08 05:15:38,170 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10562:2016-11-08 05:15:38,170 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10563:2016-11-08 05:15:38,181 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10564:2016-11-08 05:15:38,181 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10565:2016-11-08 05:15:38,211 INFO [RS_OPEN_REGION-node-5:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19229 ./node-5/hbase-root-regionserver-node-5.cluster.log:10566:2016-11-08 05:15:38,214 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10567:2016-11-08 05:15:38,218 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478582087459 ./node-5/hbase-root-regionserver-node-5.cluster.log:10576:2016-11-08 05:17:08,147 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:10577:2016-11-08 05:17:08,150 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:10578:2016-11-08 05:17:08,151 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:10579:2016-11-08 05:17:08,152 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:10580:2016-11-08 05:17:08,168 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10581:2016-11-08 05:17:08,172 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10583:2016-11-08 05:17:08,183 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10584:2016-11-08 05:17:08,183 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10586:2016-11-08 05:17:08,192 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10587:2016-11-08 05:17:08,193 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10588:2016-11-08 05:17:08,203 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10589:2016-11-08 05:17:08,204 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10590:2016-11-08 05:17:08,218 INFO [RS_OPEN_REGION-node-5:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19232 ./node-5/hbase-root-regionserver-node-5.cluster.log:10591:2016-11-08 05:17:08,221 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10592:2016-11-08 05:17:08,223 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478582087459 ./node-5/hbase-root-regionserver-node-5.cluster.log:10600:2016-11-08 05:18:17,234 INFO [PriorityRpcServer.handler=1,queue=1,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10601:2016-11-08 05:18:17,236 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478582096586] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10602:2016-11-08 05:18:17,236 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478582088636] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10603:2016-11-08 05:18:17,237 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478582096586] regionserver.HStore: Starting compaction of 1 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=616.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:10604:2016-11-08 05:18:17,237 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478582088636] regionserver.HStore: Starting compaction of 1 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=1.2 G ./node-5/hbase-root-regionserver-node-5.cluster.log:10611:2016-11-08 05:18:38,132 INFO [PriorityRpcServer.handler=12,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:10613:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:10623:2016-11-08 05:18:38,170 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478582096586] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=1, fileSize=616.5 M (616.5 M), priority=1, time=734282636636311; duration=20sec ./node-5/hbase-root-regionserver-node-5.cluster.log:10624:2016-11-08 05:18:38,171 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478582096586] regionserver.HRegion: NOT compacting region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.. Writes disabled. ./node-5/hbase-root-regionserver-node-5.cluster.log:10625:2016-11-08 05:18:38,171 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478582096586] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=1, fileSize=672.6 M (672.6 M), priority=1, time=734282637581121; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:10627:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:10637:2016-11-08 05:18:38,364 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478582088636] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=1, fileSize=1.2 G (1.2 G), priority=1, time=734282637147590; duration=21sec ./node-5/hbase-root-regionserver-node-5.cluster.log:10638:2016-11-08 05:18:38,365 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:10639:2016-11-08 05:18:38,366 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:10640:2016-11-08 05:18:38,367 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:10641:2016-11-08 05:18:38,374 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10642:2016-11-08 05:18:38,377 INFO [PriorityRpcServer.handler=9,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10643:2016-11-08 05:18:38,384 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10644:2016-11-08 05:18:38,384 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10646:2016-11-08 05:18:38,392 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10647:2016-11-08 05:18:38,392 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10648:2016-11-08 05:18:38,399 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=3, currentSize=13192064, freeSize=12825520256, maxSize=12838712320, heapSize=13192064, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:10649:2016-11-08 05:18:38,399 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:10650:2016-11-08 05:18:38,416 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=19235 ./node-5/hbase-root-regionserver-node-5.cluster.log:10651:2016-11-08 05:18:38,418 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:10652:2016-11-08 05:18:38,420 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478582087459 ./node-5/hbase-root-regionserver-node-5.cluster.log:10658:2016-11-08 05:19:17,235 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:10659:2016-11-08 05:19:17,237 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:10660:2016-11-08 05:19:17,238 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:10661:2016-11-08 05:19:17,239 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:10662:2016-11-08 05:19:17,247 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1829:2016-11-08 03:50:21,091 WARN [regionserver/node-5.cluster/192.168.124.6:16020-merges-1478577020889] regionserver.HRegionFileSystem: .regioninfo file not found for region: 393d2bfd8b1c52ce08540306659624f2 on table IntegrationTestBigLinkedList ./node-5/hbase-root-regionserver-node-5.cluster.log:1830:2016-11-08 03:50:21,112 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for TbWaF: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1831:2016-11-08 03:50:21,112 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:1832:2016-11-08 03:50:21,115 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1833:2016-11-08 03:50:21,115 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:1834:2016-11-08 03:50:21,118 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1835:2016-11-08 03:50:21,119 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:1836:2016-11-08 03:50:21,121 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nIFir: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1837:2016-11-08 03:50:21,122 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:1838:2016-11-08 03:50:21,125 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1839:2016-11-08 03:50:21,126 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:1840:2016-11-08 03:50:21,136 INFO [regionserver/node-5.cluster/192.168.124.6:16020-merges-1478577020889] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=2 ./node-5/hbase-root-regionserver-node-5.cluster.log:1841:2016-11-08 03:50:21,138 INFO [regionserver/node-5.cluster/192.168.124.6:16020-merges-1478577020889] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1842:2016-11-08 03:50:21,141 INFO [regionserver/node-5.cluster/192.168.124.6:16020-merges-1478577020889] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478576985475 ./node-5/hbase-root-regionserver-node-5.cluster.log:1843:2016-11-08 03:50:21,244 INFO [regionserver/node-5.cluster/192.168.124.6:16020-merges-1478577020889] regionserver.RegionMergeRequest: Regions merged, hbase:meta updated, and report to master. region_a=IntegrationTestBigLinkedList,,1478574759285.88ac56ffbdd3169e6bfc33bec3aa83f6., region_b=IntegrationTestBigLinkedList, \x00\x00\x00\x00\x00\x00\x00,1478575328828.1789f9fdd7130abba2b52392b5f30854.,merged region=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.. Region merge took 0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:1872:2016-11-08 03:50:45,436 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=75, memsize=44.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/eab287aaf76c45289190e83539f8c07f ./node-5/hbase-root-regionserver-node-5.cluster.log:1874:2016-11-08 03:50:46,400 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=75, memsize=79.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/53dc6dbbd5b042d3938f244caac64f1a ./node-5/hbase-root-regionserver-node-5.cluster.log:1875:2016-11-08 03:50:46,677 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=75, memsize=23.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e034612b72c848888010df5600858ff9 ./node-5/hbase-root-regionserver-node-5.cluster.log:1876:2016-11-08 03:50:46,699 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/eab287aaf76c45289190e83539f8c07f, entries=137528, sequenceid=75, filesize=3.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1877:2016-11-08 03:50:46,711 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/53dc6dbbd5b042d3938f244caac64f1a, entries=412584, sequenceid=75, filesize=5.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1878:2016-11-08 03:50:46,725 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e034612b72c848888010df5600858ff9, entries=137528, sequenceid=75, filesize=3.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1879:2016-11-08 03:50:46,727 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~146.90 MB/154031360, currentsize=77.06 MB/80801280 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4274ms, sequenceid=75, compaction requested=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1889:2016-11-08 03:50:50,051 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=301, memsize=39.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/912abab96526411383e5fd60b7e0c28f ./node-5/hbase-root-regionserver-node-5.cluster.log:1890:2016-11-08 03:50:51,241 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=301, memsize=72.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a3991be183aa4ed6b02f94a81c92e34d ./node-5/hbase-root-regionserver-node-5.cluster.log:1891:2016-11-08 03:50:51,739 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=301, memsize=20.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/67aaa0c801454ca090bc7accdf7f57f6 ./node-5/hbase-root-regionserver-node-5.cluster.log:1892:2016-11-08 03:50:52,417 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/912abab96526411383e5fd60b7e0c28f, entries=124260, sequenceid=301, filesize=3.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1894:2016-11-08 03:50:52,545 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/a3991be183aa4ed6b02f94a81c92e34d, entries=372780, sequenceid=301, filesize=4.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1895:2016-11-08 03:50:52,587 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/67aaa0c801454ca090bc7accdf7f57f6, entries=124260, sequenceid=301, filesize=3.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1896:2016-11-08 03:50:52,737 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~132.72 MB/139171200, currentsize=110.79 MB/116173120 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3720ms, sequenceid=301, compaction requested=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1903:2016-11-08 03:50:53,775 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=369, memsize=39.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1d311e3b2df44e67997e96fe1f94f0ee ./node-5/hbase-root-regionserver-node-5.cluster.log:1908:2016-11-08 03:50:55,783 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=369, memsize=71.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/84130f4f29db4437b6e370828cb685bd ./node-5/hbase-root-regionserver-node-5.cluster.log:1909:2016-11-08 03:50:56,379 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=369, memsize=20.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/649363702f0346ea868a8be68892677d ./node-5/hbase-root-regionserver-node-5.cluster.log:1910:2016-11-08 03:50:56,408 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/1d311e3b2df44e67997e96fe1f94f0ee, entries=123375, sequenceid=369, filesize=3.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1911:2016-11-08 03:50:56,534 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/84130f4f29db4437b6e370828cb685bd, entries=370125, sequenceid=369, filesize=4.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1912:2016-11-08 03:50:56,628 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/649363702f0346ea868a8be68892677d, entries=123375, sequenceid=369, filesize=3.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1913:2016-11-08 03:50:56,782 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~131.78 MB/138180000, currentsize=132.94 MB/139400800 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3775ms, sequenceid=369, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:1914:2016-11-08 03:50:56,793 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1915:2016-11-08 03:50:56,793 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.8 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1916:2016-11-08 03:50:56,802 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1917:2016-11-08 03:50:56,803 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1925:2016-11-08 03:50:58,803 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=441, memsize=44.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f66617c95aa0476caabcb490e445568e ./node-5/hbase-root-regionserver-node-5.cluster.log:1934:2016-11-08 03:51:01,240 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Completed compaction of 3 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into bebc266e142147d9840f52ebcdc1e47f(size=7.2 M), total size for store is 7.2 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:1935:2016-11-08 03:51:01,242 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=9.4 M, priority=7, time=729042203589867; duration=4sec ./node-5/hbase-root-regionserver-node-5.cluster.log:1936:2016-11-08 03:51:01,253 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1937:2016-11-08 03:51:01,254 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=14.8 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1940:2016-11-08 03:51:02,665 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=441, memsize=80.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/deb319597d77455a8fa6dc944ae27fc5 ./node-5/hbase-root-regionserver-node-5.cluster.log:1942:2016-11-08 03:51:03,711 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=441, memsize=23.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3e851c7cc59e4bf0b7bb978352a4bdf4 ./node-5/hbase-root-regionserver-node-5.cluster.log:1943:2016-11-08 03:51:03,734 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f66617c95aa0476caabcb490e445568e, entries=138620, sequenceid=441, filesize=3.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1944:2016-11-08 03:51:03,786 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/deb319597d77455a8fa6dc944ae27fc5, entries=415860, sequenceid=441, filesize=5.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1945:2016-11-08 03:51:03,945 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Completed compaction of 3 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 50ef963526974d1fb797a9df8af6b418(size=14.1 M), total size for store is 17.5 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:1946:2016-11-08 03:51:03,945 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=9.8 M, priority=7, time=729042193791671; duration=7sec ./node-5/hbase-root-regionserver-node-5.cluster.log:1947:2016-11-08 03:51:03,958 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/3e851c7cc59e4bf0b7bb978352a4bdf4, entries=138620, sequenceid=441, filesize=3.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1948:2016-11-08 03:51:04,136 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~148.06 MB/155254400, currentsize=212.06 MB/222355840 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7293ms, sequenceid=441, compaction requested=false ./node-5/hbase-root-regionserver-node-5.cluster.log:1961:2016-11-08 03:51:06,933 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=553, memsize=68.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/58dbfff4302c43f2aabc3646a3516378 ./node-5/hbase-root-regionserver-node-5.cluster.log:1972:2016-11-08 03:51:12,279 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=553, memsize=123.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/54875ec7614f4c1ca2289bd249ce412d ./node-5/hbase-root-regionserver-node-5.cluster.log:1974:2016-11-08 03:51:13,165 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=553, memsize=35.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c21cf07682234729bed63753c5a6e503 ./node-5/hbase-root-regionserver-node-5.cluster.log:1975:2016-11-08 03:51:13,189 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/58dbfff4302c43f2aabc3646a3516378, entries=212843, sequenceid=553, filesize=5.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1976:2016-11-08 03:51:13,226 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/54875ec7614f4c1ca2289bd249ce412d, entries=638529, sequenceid=553, filesize=8.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1977:2016-11-08 03:51:13,269 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/c21cf07682234729bed63753c5a6e503, entries=212843, sequenceid=553, filesize=5.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1978:2016-11-08 03:51:13,304 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~227.34 MB/238384160, currentsize=249.84 MB/261972480 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 9057ms, sequenceid=553, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:1980:2016-11-08 03:51:13,695 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Completed compaction of 3 (all) file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 27c4b8df305b4607ad87f91941692e53(size=12.6 M), total size for store is 26.7 M. This selection was in queue for 0sec, and took 12sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:1981:2016-11-08 03:51:13,695 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=14.8 M, priority=7, time=729046654288421; duration=12sec ./node-5/hbase-root-regionserver-node-5.cluster.log:1982:2016-11-08 03:51:13,747 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1983:2016-11-08 03:51:13,747 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=23.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1987:2016-11-08 03:51:13,766 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:1988:2016-11-08 03:51:13,766 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=26.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:1999:2016-11-08 03:51:15,760 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=680, memsize=79.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7e66ad1d1e814a1e89fbc6a09f01b6c4 ./node-5/hbase-root-regionserver-node-5.cluster.log:2007:2016-11-08 03:51:22,752 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=680, memsize=143.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/270369f122a2408295b90d384d806ea1 ./node-5/hbase-root-regionserver-node-5.cluster.log:2008:2016-11-08 03:51:23,643 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=680, memsize=41.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1b0aaae28e9f4e63aec59f336901b5df ./node-5/hbase-root-regionserver-node-5.cluster.log:2009:2016-11-08 03:51:23,717 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/7e66ad1d1e814a1e89fbc6a09f01b6c4, entries=248230, sequenceid=680, filesize=6.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2010:2016-11-08 03:51:24,124 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/270369f122a2408295b90d384d806ea1, entries=744690, sequenceid=680, filesize=10.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2014:2016-11-08 03:51:24,171 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Completed compaction of 3 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into faac7e27f7de41fbbef59e47bada5e62(size=27.7 M), total size for store is 34.1 M. This selection was in queue for 0sec, and took 10sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2015:2016-11-08 03:51:24,171 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=23.0 M, priority=7, time=729059148452400; duration=10sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2016:2016-11-08 03:51:24,173 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2017:2016-11-08 03:51:24,173 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=16.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2018:2016-11-08 03:51:24,175 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/1b0aaae28e9f4e63aec59f336901b5df, entries=248230, sequenceid=680, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2019:2016-11-08 03:51:24,251 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~265.14 MB/278017600, currentsize=258.23 MB/270771200 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 10928ms, sequenceid=680, compaction requested=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2028:2016-11-08 03:51:27,869 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=807, memsize=79.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/2b290d97e2664c66b26d558af7602211 ./node-5/hbase-root-regionserver-node-5.cluster.log:2033:2016-11-08 03:51:30,497 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Completed compaction of 3 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 186b0c420d57405ab932756da5da0c68(size=14.1 M), total size for store is 20.3 M. This selection was in queue for 0sec, and took 6sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2034:2016-11-08 03:51:30,497 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=16.1 M, priority=7, time=729069574205961; duration=6sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2044:2016-11-08 03:51:32,696 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=807, memsize=143.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6979ea69fae74f6ca48090fbfd465415 ./node-5/hbase-root-regionserver-node-5.cluster.log:2045:2016-11-08 03:51:34,504 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=807, memsize=41.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/451eae492b2a4c9cbf609924db13aa49 ./node-5/hbase-root-regionserver-node-5.cluster.log:2046:2016-11-08 03:51:34,544 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/2b290d97e2664c66b26d558af7602211, entries=247951, sequenceid=807, filesize=6.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2047:2016-11-08 03:51:34,565 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6979ea69fae74f6ca48090fbfd465415, entries=743853, sequenceid=807, filesize=10.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2048:2016-11-08 03:51:34,591 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/451eae492b2a4c9cbf609924db13aa49, entries=247951, sequenceid=807, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2049:2016-11-08 03:51:34,606 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~264.84 MB/277705120, currentsize=260.14 MB/272780480 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 10320ms, sequenceid=807, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2058:2016-11-08 03:51:36,515 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=936, memsize=80.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ff34eb8e65a44e44b45cdab878fe59f7 ./node-5/hbase-root-regionserver-node-5.cluster.log:2061:2016-11-08 03:51:36,991 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Completed compaction of 3 (all) file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 163436c6a94b4db7a30c8e2c64d5f94c(size=25.5 M), total size for store is 46.1 M. This selection was in queue for 0sec, and took 23sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2062:2016-11-08 03:51:36,991 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=26.7 M, priority=7, time=729059166875958; duration=23sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2063:2016-11-08 03:51:37,049 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2064:2016-11-08 03:51:37,049 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=26.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2067:2016-11-08 03:51:38,377 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2068:2016-11-08 03:51:38,377 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=40.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2070:2016-11-08 03:51:40,434 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=936, memsize=144.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a9ae38002fdc4a8bb7513b9ea0bc94de ./node-5/hbase-root-regionserver-node-5.cluster.log:2078:2016-11-08 03:51:42,520 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=936, memsize=41.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1f19b59eafaa4d64b3d3c850dd44b7a6 ./node-5/hbase-root-regionserver-node-5.cluster.log:2079:2016-11-08 03:51:42,546 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ff34eb8e65a44e44b45cdab878fe59f7, entries=249712, sequenceid=936, filesize=6.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2081:2016-11-08 03:51:42,585 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/a9ae38002fdc4a8bb7513b9ea0bc94de, entries=749136, sequenceid=936, filesize=10.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2082:2016-11-08 03:51:42,594 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/1f19b59eafaa4d64b3d3c850dd44b7a6, entries=249712, sequenceid=936, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2083:2016-11-08 03:51:42,595 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~266.72 MB/279677440, currentsize=255.55 MB/267967840 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7823ms, sequenceid=936, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2095:2016-11-08 03:51:45,396 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1066, memsize=80.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/40c2ca768c064ea192e3eb17b89df706 ./node-5/hbase-root-regionserver-node-5.cluster.log:2096:2016-11-08 03:51:45,882 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Completed compaction of 3 (all) file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into bd420631fa094f538d7bb0893b1618d9(size=24.0 M), total size for store is 30.3 M. This selection was in queue for 0sec, and took 8sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2097:2016-11-08 03:51:45,882 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=26.6 M, priority=7, time=729082450522725; duration=8sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2098:2016-11-08 03:51:45,910 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2099:2016-11-08 03:51:45,911 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.HStore: Starting compaction of 4 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=56.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2105:2016-11-08 03:51:50,699 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.HStore: Completed compaction of 3 (all) file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ca023b486dd04fc49858f5a247ddc172(size=47.5 M), total size for store is 53.9 M. This selection was in queue for 0sec, and took 12sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2106:2016-11-08 03:51:50,699 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577056784] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=40.5 M, priority=7, time=729083778555630; duration=12sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2109:2016-11-08 03:51:50,784 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1066, memsize=145.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/dde1deba1504475fab871307ba67f04c ./node-5/hbase-root-regionserver-node-5.cluster.log:2111:2016-11-08 03:51:52,287 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1066, memsize=42.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6915b20e5cc9434f81f4168836e81454 ./node-5/hbase-root-regionserver-node-5.cluster.log:2112:2016-11-08 03:51:52,328 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/40c2ca768c064ea192e3eb17b89df706, entries=250938, sequenceid=1066, filesize=6.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2113:2016-11-08 03:51:52,413 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/dde1deba1504475fab871307ba67f04c, entries=752814, sequenceid=1066, filesize=10.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2114:2016-11-08 03:51:52,477 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/6915b20e5cc9434f81f4168836e81454, entries=250938, sequenceid=1066, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2115:2016-11-08 03:51:52,486 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~268.03 MB/281050560, currentsize=257.90 MB/270430720 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 9667ms, sequenceid=1066, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2117:2016-11-08 03:51:53,200 INFO [PriorityRpcServer.handler=6,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:2120:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:2130:2016-11-08 03:51:54,531 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478576987331] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=4, fileSize=56.4 M (25.5 M, 10.3 M, 10.3 M, 10.3 M), priority=6, time=729091311672721; duration=8sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2131:2016-11-08 03:51:55,744 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1205, memsize=83.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5b493b42ae0842db8a74bcd12d99323c ./node-5/hbase-root-regionserver-node-5.cluster.log:2149:2016-11-08 03:52:00,094 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1205, memsize=151.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/969b5051100b45108249f0086a59f02c ./node-5/hbase-root-regionserver-node-5.cluster.log:2150:2016-11-08 03:52:00,779 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1205, memsize=43.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/eafbc6a06c6b48d7b1e9af054031c7a4 ./node-5/hbase-root-regionserver-node-5.cluster.log:2151:2016-11-08 03:52:00,802 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5b493b42ae0842db8a74bcd12d99323c, entries=261323, sequenceid=1205, filesize=6.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2152:2016-11-08 03:52:00,844 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/969b5051100b45108249f0086a59f02c, entries=783969, sequenceid=1205, filesize=10.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2153:2016-11-08 03:52:00,862 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/eafbc6a06c6b48d7b1e9af054031c7a4, entries=261323, sequenceid=1205, filesize=6.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2154:2016-11-08 03:52:00,868 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~279.12 MB/292681760, currentsize=208.03 MB/218135680 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 7824ms, sequenceid=1205, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2155:2016-11-08 03:52:00,868 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2157:2016-11-08 03:52:02,261 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1547, memsize=62.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8dcf38b954d94aea868b5aba3b5d2019 ./node-5/hbase-root-regionserver-node-5.cluster.log:2164:2016-11-08 03:52:06,101 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1547, memsize=112.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5366d59d1a33481fbf52f1621218266b ./node-5/hbase-root-regionserver-node-5.cluster.log:2165:2016-11-08 03:52:06,700 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1547, memsize=32.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9ab38eaa2c4d4732ac42d4d864b3d3aa ./node-5/hbase-root-regionserver-node-5.cluster.log:2166:2016-11-08 03:52:06,740 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/8dcf38b954d94aea868b5aba3b5d2019, entries=194764, sequenceid=1547, filesize=5.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2328:2016-11-08 03:56:48,526 INFO [PriorityRpcServer.handler=17,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2331:2016-11-08 03:56:48,920 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2332:2016-11-08 03:56:48,941 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2335:2016-11-08 03:56:49,422 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2336:2016-11-08 03:56:49,423 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2337:2016-11-08 03:56:49,807 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2338:2016-11-08 03:56:49,808 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2339:2016-11-08 03:56:50,093 INFO [RS_OPEN_REGION-node-5:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=5284 ./node-5/hbase-root-regionserver-node-5.cluster.log:2340:2016-11-08 03:56:50,138 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2341:2016-11-08 03:56:50,184 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2342:2016-11-08 03:56:50,195 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=16.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2343:2016-11-08 03:56:50,211 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2344:2016-11-08 03:56:50,211 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=6.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2347:2016-11-08 03:56:50,456 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577166101 ./node-5/hbase-root-regionserver-node-5.cluster.log:2351:2016-11-08 03:56:53,907 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into c6073ea02f054356a58bb2542de140c8(size=10.2 M), total size for store is 274.0 M. This selection was in queue for 0sec, and took 3sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2352:2016-11-08 03:56:53,909 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=6.9 M, priority=-2, time=729395611713714; duration=3sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2353:2016-11-08 03:56:53,918 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2354:2016-11-08 03:56:53,918 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=7.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2360:2016-11-08 03:56:55,575 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6b3fad1ae1b444b0ab91667911b60e6d(size=5.3 M), total size for store is 159.8 M. This selection was in queue for 0sec, and took 1sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2361:2016-11-08 03:56:55,575 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=7.2 M, priority=-2, time=729399319305042; duration=1sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2362:2016-11-08 03:56:55,728 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2363:2016-11-08 03:56:55,728 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577410140] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=41.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2364:2016-11-08 03:56:58,168 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1fe11c2cbf8f4d03b0811d2a3122902a(size=13.8 M), total size for store is 355.9 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2365:2016-11-08 03:56:58,169 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=16.1 M, priority=-3, time=729395583649073; duration=7sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2366:2016-11-08 03:56:58,197 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2367:2016-11-08 03:56:58,197 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577172210] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2368:2016-11-08 03:56:59,695 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:2626:2016-11-08 04:04:37,363 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2627:2016-11-08 04:04:37,364 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2628:2016-11-08 04:04:37,462 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2629:2016-11-08 04:04:37,463 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2630:2016-11-08 04:04:37,751 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2631:2016-11-08 04:04:37,752 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2632:2016-11-08 04:04:37,756 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2633:2016-11-08 04:04:37,756 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2634:2016-11-08 04:04:37,758 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2635:2016-11-08 04:04:37,759 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2679:2016-11-08 04:04:46,027 INFO [PriorityRpcServer.handler=3,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2680:2016-11-08 04:04:46,079 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2681:2016-11-08 04:04:46,079 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2682:2016-11-08 04:04:46,219 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2683:2016-11-08 04:04:46,221 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2684:2016-11-08 04:04:46,574 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2685:2016-11-08 04:04:46,575 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2686:2016-11-08 04:04:46,576 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2687:2016-11-08 04:04:46,576 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2688:2016-11-08 04:04:46,587 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2689:2016-11-08 04:04:46,587 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2691:2016-11-08 04:04:46,881 INFO [RS_OPEN_REGION-node-5:16020-0] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=10985 ./node-5/hbase-root-regionserver-node-5.cluster.log:2692:2016-11-08 04:04:46,902 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2693:2016-11-08 04:04:46,939 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:2716:2016-11-08 04:04:49,228 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2717:2016-11-08 04:04:49,228 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=80.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2740:2016-11-08 04:05:03,187 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:2748:2016-11-08 04:05:09,879 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 17764e33bbbb4f10b767d7e82087d2b3(size=66.6 M), total size for store is 724.2 M. This selection was in queue for 0sec, and took 20sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:2749:2016-11-08 04:05:09,879 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=80.6 M, priority=-2, time=729874629661840; duration=20sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2750:2016-11-08 04:05:09,885 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2751:2016-11-08 04:05:09,885 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=130.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2756:2016-11-08 04:05:16,407 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11143, memsize=97.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/22585ee46daf4b6eba0c33b910913e34 ./node-5/hbase-root-regionserver-node-5.cluster.log:2769:2016-11-08 04:05:22,043 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:2772:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:2782:2016-11-08 04:05:22,780 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=130.7 M (48.5 M, 30.2 M, 52.0 M), priority=0, time=729895285858311; duration=12sec ./node-5/hbase-root-regionserver-node-5.cluster.log:2790:2016-11-08 04:05:24,219 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11143, memsize=180.7 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/90c32affe2ba411681687b71a1d1f58b ./node-5/hbase-root-regionserver-node-5.cluster.log:2791:2016-11-08 04:05:25,416 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11143, memsize=51.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/af093c56606242ccb66d3ad21e724062 ./node-5/hbase-root-regionserver-node-5.cluster.log:2792:2016-11-08 04:05:25,461 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/22585ee46daf4b6eba0c33b910913e34, entries=303734, sequenceid=11143, filesize=9.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2793:2016-11-08 04:05:25,488 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/90c32affe2ba411681687b71a1d1f58b, entries=911202, sequenceid=11143, filesize=18.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2794:2016-11-08 04:05:25,522 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/af093c56606242ccb66d3ad21e724062, entries=303734, sequenceid=11143, filesize=8.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2795:2016-11-08 04:05:25,539 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~329.06 MB/345041824, currentsize=189.58 MB/198788640 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 14844ms, sequenceid=11143, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2796:2016-11-08 04:05:25,540 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2798:2016-11-08 04:05:26,159 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:2799:2016-11-08 04:05:26,696 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11237, memsize=56.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e66416088c764c11af2ad6486e954e08 ./node-5/hbase-root-regionserver-node-5.cluster.log:2804:2016-11-08 04:05:29,715 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11237, memsize=104.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8e6a6c36f13f4d13aed83eb783d7bbc8 ./node-5/hbase-root-regionserver-node-5.cluster.log:2805:2016-11-08 04:05:30,879 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11237, memsize=29.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/876cebf14cfc4c789a19f31d657d3975 ./node-5/hbase-root-regionserver-node-5.cluster.log:2806:2016-11-08 04:05:30,917 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/e66416088c764c11af2ad6486e954e08, entries=174990, sequenceid=11237, filesize=5.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2807:2016-11-08 04:05:30,945 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/8e6a6c36f13f4d13aed83eb783d7bbc8, entries=524970, sequenceid=11237, filesize=10.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2808:2016-11-08 04:05:30,983 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/876cebf14cfc4c789a19f31d657d3975, entries=174990, sequenceid=11237, filesize=4.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2809:2016-11-08 04:05:31,084 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Finished memstore flush of ~189.58 MB/198788640, currentsize=174.58 MB/183057312 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 5543ms, sequenceid=11237, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2813:2016-11-08 04:05:32,767 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11324, memsize=53.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/5fcfac78f1ad44f0bbb070a10d1d185b ./node-5/hbase-root-regionserver-node-5.cluster.log:2816:2016-11-08 04:05:34,551 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11324, memsize=99.5 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d1bee8c851214c65a2bea120f847a26c ./node-5/hbase-root-regionserver-node-5.cluster.log:2817:2016-11-08 04:05:35,037 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11324, memsize=28.1 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/30164ed1fb6142b5b2f814eac3a95f30 ./node-5/hbase-root-regionserver-node-5.cluster.log:2818:2016-11-08 04:05:35,048 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/5fcfac78f1ad44f0bbb070a10d1d185b, entries=167181, sequenceid=11324, filesize=5.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2819:2016-11-08 04:05:35,059 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/d1bee8c851214c65a2bea120f847a26c, entries=501543, sequenceid=11324, filesize=10.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2820:2016-11-08 04:05:35,065 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/30164ed1fb6142b5b2f814eac3a95f30, entries=167181, sequenceid=11324, filesize=4.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2821:2016-11-08 04:05:35,081 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Finished memstore flush of ~181.12 MB/189917616, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 3538ms, sequenceid=11324, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:2822:2016-11-08 04:05:35,084 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:2823:2016-11-08 04:05:35,087 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:2824:2016-11-08 04:05:35,087 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:2825:2016-11-08 04:05:35,087 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:2826:2016-11-08 04:05:35,105 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:2827:2016-11-08 04:05:35,121 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2828:2016-11-08 04:05:35,147 INFO [PriorityRpcServer.handler=9,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2831:2016-11-08 04:05:35,331 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2832:2016-11-08 04:05:35,332 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2833:2016-11-08 04:05:35,463 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2834:2016-11-08 04:05:35,463 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2835:2016-11-08 04:05:35,657 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2836:2016-11-08 04:05:35,657 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2837:2016-11-08 04:05:35,659 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2838:2016-11-08 04:05:35,659 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2839:2016-11-08 04:05:35,660 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:2840:2016-11-08 04:05:35,660 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:2842:2016-11-08 04:05:35,825 INFO [RS_OPEN_REGION-node-5:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=11328 ./node-5/hbase-root-regionserver-node-5.cluster.log:2843:2016-11-08 04:05:35,839 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2844:2016-11-08 04:05:35,842 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2845:2016-11-08 04:05:35,842 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 5 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2846:2016-11-08 04:05:35,851 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:2847:2016-11-08 04:05:35,851 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=39.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2848:2016-11-08 04:05:35,861 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:2872:2016-11-08 04:05:41,080 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:2875:2016-11-08 04:05:42,311 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11390, memsize=37.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9372a1da57214321a918ce412a2d72f3 ./node-5/hbase-root-regionserver-node-5.cluster.log:2894:2016-11-08 04:05:44,090 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11390, memsize=70.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/859789ff47384170a357c10986641152 ./node-5/hbase-root-regionserver-node-5.cluster.log:2906:2016-11-08 04:05:46,472 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11390, memsize=19.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/40264422c9be43ea8ca32b58f6ba7e6d ./node-5/hbase-root-regionserver-node-5.cluster.log:2908:2016-11-08 04:05:46,652 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/9372a1da57214321a918ce412a2d72f3, entries=117913, sequenceid=11390, filesize=3.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2909:2016-11-08 04:05:46,726 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/859789ff47384170a357c10986641152, entries=353739, sequenceid=11390, filesize=7.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2910:2016-11-08 04:05:46,813 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/40264422c9be43ea8ca32b58f6ba7e6d, entries=117913, sequenceid=11390, filesize=2.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:2911:2016-11-08 04:05:46,875 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool5-thread-1] regionserver.HRegion: Finished memstore flush of ~127.74 MB/133949168, currentsize=73.63 MB/77204832 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6508ms, sequenceid=11390, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3066:2016-11-08 04:05:49,635 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11447, memsize=34.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/80a5c317cb2e439089ec05073a40967d ./node-5/hbase-root-regionserver-node-5.cluster.log:3067:2016-11-08 04:05:51,691 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11447, memsize=63.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/80929aa68e5c4b05b49fda1e78b01a37 ./node-5/hbase-root-regionserver-node-5.cluster.log:3068:2016-11-08 04:05:54,275 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11447, memsize=17.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c0ca852807614e31b94b9665f2b93609 ./node-5/hbase-root-regionserver-node-5.cluster.log:3069:2016-11-08 04:05:54,372 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/80a5c317cb2e439089ec05073a40967d, entries=106227, sequenceid=11447, filesize=3.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3070:2016-11-08 04:05:54,392 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/80929aa68e5c4b05b49fda1e78b01a37, entries=318681, sequenceid=11447, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3071:2016-11-08 04:05:54,416 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/c0ca852807614e31b94b9665f2b93609, entries=106227, sequenceid=11447, filesize=2.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3072:2016-11-08 04:05:54,574 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool6-thread-1] regionserver.HRegion: Finished memstore flush of ~115.08 MB/120673872, currentsize=212.32 MB/222628736 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 6943ms, sequenceid=11447, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3091:2016-11-08 04:06:25,727 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1bca62aeb7d14077b701dde4094ca6ff(size=33.0 M), total size for store is 770.6 M. This selection was in queue for 0sec, and took 49sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3092:2016-11-08 04:06:25,727 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=39.5 M, priority=-3, time=729921252261801; duration=49sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3093:2016-11-08 04:06:25,775 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3094:2016-11-08 04:06:25,775 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=46.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3095:2016-11-08 04:06:40,227 INFO [PriorityRpcServer.handler=15,queue=1,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3096:2016-11-08 04:06:51,683 INFO [PriorityRpcServer.handler=17,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:3098:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:3108:2016-11-08 04:06:52,050 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=46.4 M (33.0 M, 7.1 M, 6.3 M), priority=-3, time=729971176407469; duration=26sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3112:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:3122:2016-11-08 04:06:53,216 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3124:2016-11-08 04:06:53,231 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=5, fileSize=44.7 M (10.1 M, 15.0 M, 9.2 M, 5.3 M, 5.0 M), priority=3, time=729921242915678; duration=1mins, 17sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3125:2016-11-08 04:06:53,231 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: NOT compacting region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.. Writes disabled. ./node-5/hbase-root-regionserver-node-5.cluster.log:3126:2016-11-08 04:06:53,239 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=9.5 M (4.7 M, 2.5 M, 2.3 M), priority=1, time=729985652492091; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3129:2016-11-08 04:06:55,509 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11696, memsize=156.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/04883425255341239748f62fb972dcc6 ./node-5/hbase-root-regionserver-node-5.cluster.log:3134:2016-11-08 04:07:00,375 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11696, memsize=290.8 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6fa439c873ea4e1f97f7ae4404e83f65 ./node-5/hbase-root-regionserver-node-5.cluster.log:3137:2016-11-08 04:07:05,584 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11696, memsize=82.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4bf3f6d0f9ad40abacbc60b7e0848d73 ./node-5/hbase-root-regionserver-node-5.cluster.log:3138:2016-11-08 04:07:05,597 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/04883425255341239748f62fb972dcc6, entries=488619, sequenceid=11696, filesize=15.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3139:2016-11-08 04:07:05,602 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6fa439c873ea4e1f97f7ae4404e83f65, entries=1465857, sequenceid=11696, filesize=30.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3140:2016-11-08 04:07:05,608 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/4bf3f6d0f9ad40abacbc60b7e0848d73, entries=488619, sequenceid=11696, filesize=10.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3141:2016-11-08 04:07:05,616 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Finished memstore flush of ~529.36 MB/555071184, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 12400ms, sequenceid=11696, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3142:2016-11-08 04:07:05,625 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:3143:2016-11-08 04:07:05,629 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:3144:2016-11-08 04:07:05,629 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:3145:2016-11-08 04:07:05,629 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:3146:2016-11-08 04:07:05,632 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:3147:2016-11-08 04:07:05,649 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3148:2016-11-08 04:07:05,655 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3149:2016-11-08 04:07:05,662 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3150:2016-11-08 04:07:05,662 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3151:2016-11-08 04:07:05,763 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3152:2016-11-08 04:07:05,763 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3153:2016-11-08 04:07:05,982 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3154:2016-11-08 04:07:05,982 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3155:2016-11-08 04:07:05,983 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3156:2016-11-08 04:07:05,983 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3157:2016-11-08 04:07:05,984 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3158:2016-11-08 04:07:05,985 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3160:2016-11-08 04:07:06,205 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=11700 ./node-5/hbase-root-regionserver-node-5.cluster.log:3161:2016-11-08 04:07:06,239 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3162:2016-11-08 04:07:06,242 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3163:2016-11-08 04:07:06,243 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=11.8 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3164:2016-11-08 04:07:06,274 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:3180:2016-11-08 04:07:07,385 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3181:2016-11-08 04:07:07,386 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=44.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3218:2016-11-08 04:07:18,603 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:3238:2016-11-08 04:07:38,703 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 1350b762682a429cae660bde2901a464(size=14.9 M), total size for store is 613.7 M. This selection was in queue for 0sec, and took 32sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3239:2016-11-08 04:07:38,703 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=3, fileSize=11.8 M, priority=0, time=730011643823822; duration=32sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3240:2016-11-08 04:07:38,711 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3241:2016-11-08 04:07:38,711 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=9.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3242:2016-11-08 04:07:40,251 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3243:2016-11-08 04:07:41,023 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into db2fd4e766414481abd88afac2cbe738(size=8.5 M), total size for store is 369.6 M. This selection was in queue for 0sec, and took 2sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3244:2016-11-08 04:07:41,023 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=9.5 M, priority=-4, time=730044112709443; duration=2sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3245:2016-11-08 04:07:41,024 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3246:2016-11-08 04:07:41,024 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=21.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3247:2016-11-08 04:07:45,045 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into db5d548c42f64947875e9a70bf6a1114(size=20.2 M), total size for store is 368.1 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3248:2016-11-08 04:07:45,045 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=21.7 M, priority=-2, time=730046425164349; duration=4sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3252:2016-11-08 04:07:55,456 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into ed121c17c0564073b9aae5a53f514f95(size=36.5 M), total size for store is 793.6 M. This selection was in queue for 0sec, and took 48sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3253:2016-11-08 04:07:55,456 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=44.0 M, priority=-4, time=730012786786836; duration=48sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3254:2016-11-08 04:07:55,457 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3255:2016-11-08 04:07:55,457 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=130.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3258:2016-11-08 04:08:03,494 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3259:2016-11-08 04:08:03,494 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=26.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3260:2016-11-08 04:08:07,646 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6870689b79b74905a67f2231e41d4279(size=22.0 M), total size for store is 363.2 M. This selection was in queue for 0sec, and took 4sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3261:2016-11-08 04:08:07,647 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=26.9 M, priority=0, time=730068895220565; duration=4sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3262:2016-11-08 04:08:07,647 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3263:2016-11-08 04:08:07,647 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 8 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=613.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3264:2016-11-08 04:08:48,691 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Waited 90089ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3266:2016-11-08 04:08:51,179 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11957, memsize=155.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/1b227a1e09b74869977dda7c7ce1e148 ./node-5/hbase-root-regionserver-node-5.cluster.log:3267:2016-11-08 04:08:55,496 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11957, memsize=289.3 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e8067e2b83c04e82bc19c508b0fbdb69 ./node-5/hbase-root-regionserver-node-5.cluster.log:3268:2016-11-08 04:09:01,303 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=11957, memsize=81.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/372d97f01f614c0bb649c18b4c72452b ./node-5/hbase-root-regionserver-node-5.cluster.log:3269:2016-11-08 04:09:01,347 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/1b227a1e09b74869977dda7c7ce1e148, entries=486175, sequenceid=11957, filesize=14.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3270:2016-11-08 04:09:01,360 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/e8067e2b83c04e82bc19c508b0fbdb69, entries=1458525, sequenceid=11957, filesize=30.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3271:2016-11-08 04:09:01,392 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/372d97f01f614c0bb649c18b4c72452b, entries=486175, sequenceid=11957, filesize=10.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3272:2016-11-08 04:09:01,403 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~526.71 MB/552294800, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 12712ms, sequenceid=11957, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3277:2016-11-08 04:09:05,587 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:3296:2016-11-08 04:09:42,585 INFO [PriorityRpcServer.handler=4,queue=0,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3332:2016-11-08 04:09:51,979 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:3334:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:3344:2016-11-08 04:09:53,383 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=130.7 M (48.5 M, 30.2 M, 52.0 M), priority=-2, time=730060857916897; duration=1mins, 57sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3348:java.io.InterruptedIOException: Aborting compaction of store big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:3358:2016-11-08 04:09:54,028 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=8, fileSize=613.7 M (417.5 M, 126.6 M, 10.1 M, 15.0 M, 9.2 M, 5.3 M, 14.9 M, 15.0 M), priority=1, time=730045656178443; duration=1mins, 46sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3359:2016-11-08 04:09:54,028 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: NOT compacting region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.. Writes disabled. ./node-5/hbase-root-regionserver-node-5.cluster.log:3360:2016-11-08 04:09:54,028 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=99.9 M (33.0 M, 36.5 M, 30.4 M), priority=1, time=730168072296796; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3361:2016-11-08 04:09:54,028 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: NOT compacting region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.. Writes disabled. ./node-5/hbase-root-regionserver-node-5.cluster.log:3362:2016-11-08 04:09:54,028 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=9, fileSize=373.8 M (212.9 M, 56.4 M, 14.6 M, 12.1 M, 22.0 M, 14.4 M, 20.2 M, 10.7 M, 10.6 M), priority=1, time=730168073253485; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3363:2016-11-08 04:09:54,031 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3373:2016-11-08 04:09:56,715 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12207, memsize=153.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0dbb83fa26ac4a47bfa37c624e856222 ./node-5/hbase-root-regionserver-node-5.cluster.log:3387:2016-11-08 04:10:02,389 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12207, memsize=285.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/79758baace0c4d3c8de51e364575b717 ./node-5/hbase-root-regionserver-node-5.cluster.log:3390:2016-11-08 04:10:07,598 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12207, memsize=80.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/26f54d3c04794ac592e12c603012faf1 ./node-5/hbase-root-regionserver-node-5.cluster.log:3391:2016-11-08 04:10:07,609 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/0dbb83fa26ac4a47bfa37c624e856222, entries=479330, sequenceid=12207, filesize=14.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3392:2016-11-08 04:10:07,621 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/79758baace0c4d3c8de51e364575b717, entries=1437990, sequenceid=12207, filesize=30.0 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3393:2016-11-08 04:10:07,633 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/26f54d3c04794ac592e12c603012faf1, entries=479330, sequenceid=12207, filesize=10.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3394:2016-11-08 04:10:07,640 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Finished memstore flush of ~519.29 MB/544518880, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 13609ms, sequenceid=12207, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3395:2016-11-08 04:10:07,710 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:3396:2016-11-08 04:10:07,716 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:3397:2016-11-08 04:10:07,716 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:3398:2016-11-08 04:10:07,716 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:3399:2016-11-08 04:10:07,725 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:3400:2016-11-08 04:10:07,749 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3401:2016-11-08 04:10:07,759 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3403:2016-11-08 04:10:07,776 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3404:2016-11-08 04:10:07,776 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3406:2016-11-08 04:10:08,086 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3407:2016-11-08 04:10:08,086 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3408:2016-11-08 04:10:08,381 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3409:2016-11-08 04:10:08,381 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3410:2016-11-08 04:10:08,383 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3411:2016-11-08 04:10:08,383 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3412:2016-11-08 04:10:08,384 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3413:2016-11-08 04:10:08,384 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3415:2016-11-08 04:10:08,528 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=12211 ./node-5/hbase-root-regionserver-node-5.cluster.log:3416:2016-11-08 04:10:08,547 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3417:2016-11-08 04:10:08,725 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:3436:2016-11-08 04:10:09,805 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3437:2016-11-08 04:10:09,805 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=99.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3453:2016-11-08 04:10:10,727 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on big in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3454:2016-11-08 04:10:10,727 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=39.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3515:2016-11-08 04:10:35,573 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into fb4a366ffc0045fcb6cff8df2d15d81d(size=115.6 M), total size for store is 869.8 M. This selection was in queue for 0sec, and took 25sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3516:2016-11-08 04:10:35,573 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=99.9 M, priority=-4, time=730195206037604; duration=25sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3525:2016-11-08 04:10:48,413 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:3537:2016-11-08 04:11:23,562 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Completed compaction of 4 file(s) in big of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 6ff7d8fbbb374be2b7863f77a4e8f09b(size=53.6 M), total size for store is 657.3 M. This selection was in queue for 0sec, and took 1mins, 12sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3538:2016-11-08 04:11:23,562 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=4, fileSize=39.6 M, priority=0, time=730196128513476; duration=1mins, 12sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3543:2016-11-08 04:11:42,032 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12649, memsize=153.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/c78fa31bb948488c871b0ef64ebcb72d ./node-5/hbase-root-regionserver-node-5.cluster.log:3544:2016-11-08 04:11:45,896 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12649, memsize=285.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/536d79dc5066472cb71bb23ed97ad439 ./node-5/hbase-root-regionserver-node-5.cluster.log:3545:2016-11-08 04:11:50,507 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=12649, memsize=80.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9c936b03fa6c4dfbae494e9023e848ef ./node-5/hbase-root-regionserver-node-5.cluster.log:3546:2016-11-08 04:11:50,517 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/c78fa31bb948488c871b0ef64ebcb72d, entries=479101, sequenceid=12649, filesize=17.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3547:2016-11-08 04:11:50,522 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/536d79dc5066472cb71bb23ed97ad439, entries=1437303, sequenceid=12649, filesize=30.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3548:2016-11-08 04:11:50,566 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/9c936b03fa6c4dfbae494e9023e848ef, entries=479101, sequenceid=12649, filesize=10.8 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3549:2016-11-08 04:11:50,567 INFO [rs(node-5.cluster,16020,1478577464990)-flush-proc-pool7-thread-1] regionserver.HRegion: Finished memstore flush of ~519.05 MB/544258736, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 10348ms, sequenceid=12649, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3588:2016-11-08 04:12:18,997 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Waited 90584ms on a compaction to clean up 'too many store files'; waited long enough... proceeding with flush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3594:2016-11-08 04:12:22,401 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13055, memsize=144.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ca8d03a883e646ca90264f31e506ae99 ./node-5/hbase-root-regionserver-node-5.cluster.log:3596:2016-11-08 04:12:27,058 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13055, memsize=268.1 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9ab1ba55f22f4643ae851fee0546a8f7 ./node-5/hbase-root-regionserver-node-5.cluster.log:3600:2016-11-08 04:12:32,096 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13055, memsize=75.6 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e78b2d299e25423a8c927ea59af86ecb ./node-5/hbase-root-regionserver-node-5.cluster.log:3601:2016-11-08 04:12:32,118 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/ca8d03a883e646ca90264f31e506ae99, entries=450505, sequenceid=13055, filesize=16.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3602:2016-11-08 04:12:32,128 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/9ab1ba55f22f4643ae851fee0546a8f7, entries=1351515, sequenceid=13055, filesize=28.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3603:2016-11-08 04:12:32,148 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/e78b2d299e25423a8c927ea59af86ecb, entries=450505, sequenceid=13055, filesize=10.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3604:2016-11-08 04:12:32,151 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~488.07 MB/511773680, currentsize=25.61 MB/26850496 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 13153ms, sequenceid=13055, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3619:2016-11-08 04:12:40,259 INFO [PriorityRpcServer.handler=11,queue=1,port=16020] regionserver.RSRpcServices: Compacting IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3622:2016-11-08 04:12:43,278 WARN [MemStoreFlusher.0] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:3635:2016-11-08 04:12:51,697 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:3636:2016-11-08 04:12:51,698 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3638:2016-11-08 04:12:53,461 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13314, memsize=94.0 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/e18a7ac1eaab494eaf23eca45a18a609 ./node-5/hbase-root-regionserver-node-5.cluster.log:3641:2016-11-08 04:12:57,733 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13314, memsize=174.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/3ecde4ba8d0144f18085369c99d476ef ./node-5/hbase-root-regionserver-node-5.cluster.log:3643:2016-11-08 04:13:03,409 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13314, memsize=49.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/d7a3c87327a24918bb1c74bf87de62fb ./node-5/hbase-root-regionserver-node-5.cluster.log:3644:2016-11-08 04:13:03,434 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/e18a7ac1eaab494eaf23eca45a18a609, entries=293436, sequenceid=13314, filesize=10.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3645:2016-11-08 04:13:03,459 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/3ecde4ba8d0144f18085369c99d476ef, entries=880308, sequenceid=13314, filesize=18.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3647:2016-11-08 04:13:03,547 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/d7a3c87327a24918bb1c74bf87de62fb, entries=293436, sequenceid=13314, filesize=6.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3648:2016-11-08 04:13:03,551 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Finished memstore flush of ~317.90 MB/333343296, currentsize=195.55 MB/205044592 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 11853ms, sequenceid=13314, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3650:2016-11-08 04:13:04,342 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13475, memsize=57.8 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/9d98bb2fde774a928a6be497370ad6db ./node-5/hbase-root-regionserver-node-5.cluster.log:3651:2016-11-08 04:13:05,945 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13475, memsize=107.4 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/81701a4ce89a4901adb26cc65c81992c ./node-5/hbase-root-regionserver-node-5.cluster.log:3652:2016-11-08 04:13:07,900 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13475, memsize=30.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0798271a533141fcb67eaecad57422a5 ./node-5/hbase-root-regionserver-node-5.cluster.log:3653:2016-11-08 04:13:07,911 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/9d98bb2fde774a928a6be497370ad6db, entries=180497, sequenceid=13475, filesize=6.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3654:2016-11-08 04:13:07,965 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/81701a4ce89a4901adb26cc65c81992c, entries=541491, sequenceid=13475, filesize=11.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3655:2016-11-08 04:13:07,976 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/0798271a533141fcb67eaecad57422a5, entries=180497, sequenceid=13475, filesize=3.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3656:2016-11-08 04:13:07,983 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Finished memstore flush of ~195.55 MB/205044592, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 4432ms, sequenceid=13475, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3657:2016-11-08 04:13:08,002 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:3658:2016-11-08 04:13:08,016 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:3659:2016-11-08 04:13:08,016 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:3660:2016-11-08 04:13:08,016 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:3661:2016-11-08 04:13:08,039 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:3662:2016-11-08 04:13:08,102 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3663:2016-11-08 04:13:08,120 INFO [PriorityRpcServer.handler=16,queue=0,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3664:2016-11-08 04:13:08,187 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3665:2016-11-08 04:13:08,187 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3666:2016-11-08 04:13:08,195 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3667:2016-11-08 04:13:08,195 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3668:2016-11-08 04:13:08,467 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3669:2016-11-08 04:13:08,467 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3670:2016-11-08 04:13:08,724 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3671:2016-11-08 04:13:08,724 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3672:2016-11-08 04:13:08,726 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3673:2016-11-08 04:13:08,726 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3674:2016-11-08 04:13:08,727 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3675:2016-11-08 04:13:08,727 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3677:2016-11-08 04:13:08,994 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=13479 ./node-5/hbase-root-regionserver-node-5.cluster.log:3678:2016-11-08 04:13:09,039 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3679:2016-11-08 04:13:09,058 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:3693:2016-11-08 04:13:09,416 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3694:2016-11-08 04:13:09,416 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=57.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3709:2016-11-08 04:13:11,361 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3710:2016-11-08 04:13:11,361 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=20.5 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3720:2016-11-08 04:13:18,734 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 5a0434c93bcd453fa862f2a153229aef(size=57.6 M), total size for store is 957.6 M. This selection was in queue for 0sec, and took 9sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3721:2016-11-08 04:13:18,734 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=57.9 M, priority=-6, time=730374816996485; duration=9sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3722:2016-11-08 04:13:18,738 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3723:2016-11-08 04:13:18,738 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=117.8 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3724:2016-11-08 04:13:18,824 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into bfc169adff8c44e184661f0f3ed59cf0(size=26.2 M), total size for store is 421.2 M. This selection was in queue for 0sec, and took 7sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3725:2016-11-08 04:13:18,824 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=20.5 M, priority=-4, time=730376762040391; duration=7sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3726:2016-11-08 04:13:18,829 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HRegion: Starting compaction on tiny in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3727:2016-11-08 04:13:18,829 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Starting compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=31.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3793:2016-11-08 04:13:28,020 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.HStore: Completed compaction of 3 file(s) in tiny of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into a8602f41d8634669a829198c2fc1bb9c(size=41.1 M), total size for store is 430.6 M. This selection was in queue for 0sec, and took 9sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3794:2016-11-08 04:13:28,020 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=31.7 M, priority=-2, time=730384230180947; duration=9sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3803:2016-11-08 04:13:32,471 WARN [MemStoreFlusher.1] regionserver.MemStoreFlusher: Region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. has too many store files; delaying flush up to 90000ms ./node-5/hbase-root-regionserver-node-5.cluster.log:3810:2016-11-08 04:13:35,719 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Completed compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into 7c15b0cc20c94e15a7650f21994bf254(size=118.4 M), total size for store is 958.2 M. This selection was in queue for 0sec, and took 16sec to execute. ./node-5/hbase-root-regionserver-node-5.cluster.log:3811:2016-11-08 04:13:35,719 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Completed compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=117.8 M, priority=-4, time=730384139558698; duration=16sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3820:2016-11-08 04:14:21,479 INFO [PriorityRpcServer.handler=2,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:3821:2016-11-08 04:14:21,486 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3823:2016-11-08 04:14:23,419 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13882, memsize=153.4 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/225e9fa1839f4c4385d1a1f0ca321370 ./node-5/hbase-root-regionserver-node-5.cluster.log:3824:2016-11-08 04:14:27,520 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13882, memsize=284.9 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0111a494980e4757ba8b8760bf6df21f ./node-5/hbase-root-regionserver-node-5.cluster.log:3825:2016-11-08 04:14:32,314 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13882, memsize=80.3 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/8137603459374f2a89784df508c16969 ./node-5/hbase-root-regionserver-node-5.cluster.log:3826:2016-11-08 04:14:32,328 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/225e9fa1839f4c4385d1a1f0ca321370, entries=478676, sequenceid=13882, filesize=17.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3827:2016-11-08 04:14:32,353 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/0111a494980e4757ba8b8760bf6df21f, entries=1436028, sequenceid=13882, filesize=30.2 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3828:2016-11-08 04:14:32,371 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/8137603459374f2a89784df508c16969, entries=478676, sequenceid=13882, filesize=10.9 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3829:2016-11-08 04:14:32,377 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Finished memstore flush of ~518.59 MB/543775936, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 10891ms, sequenceid=13882, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3830:2016-11-08 04:14:32,378 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-5/hbase-root-regionserver-node-5.cluster.log:3831:2016-11-08 04:14:32,400 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:3832:2016-11-08 04:14:32,409 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:3833:2016-11-08 04:14:32,409 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:3834:2016-11-08 04:14:32,409 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:3835:2016-11-08 04:14:32,412 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:3836:2016-11-08 04:14:32,420 INFO [RS_CLOSE_REGION-node-5:16020-0] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3837:2016-11-08 04:14:32,425 INFO [PriorityRpcServer.handler=3,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3838:2016-11-08 04:14:32,431 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3839:2016-11-08 04:14:32,431 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3840:2016-11-08 04:14:32,432 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3841:2016-11-08 04:14:32,432 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3842:2016-11-08 04:14:32,494 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3843:2016-11-08 04:14:32,494 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3844:2016-11-08 04:14:32,655 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3845:2016-11-08 04:14:32,655 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3846:2016-11-08 04:14:32,656 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3847:2016-11-08 04:14:32,656 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3848:2016-11-08 04:14:32,657 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=52, currentSize=15770016, freeSize=12822942304, maxSize=12838712320, heapSize=15770016, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3849:2016-11-08 04:14:32,657 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3851:2016-11-08 04:14:32,805 INFO [RS_OPEN_REGION-node-5:16020-1] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=13886 ./node-5/hbase-root-regionserver-node-5.cluster.log:3852:2016-11-08 04:14:32,820 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3853:2016-11-08 04:14:32,835 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:3887:2016-11-08 04:14:36,272 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HRegion: Starting compaction on meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3888:2016-11-08 04:14:36,272 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.HStore: Starting compaction of 3 file(s) in meta of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. into tmpdir=hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp, totalSize=130.7 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3917:2016-11-08 04:14:42,845 INFO [PriorityRpcServer.handler=5,queue=1,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to null ./node-5/hbase-root-regionserver-node-5.cluster.log:3919:java.io.InterruptedIOException: Aborting compaction of store meta in region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. because it was interrupted. ./node-5/hbase-root-regionserver-node-5.cluster.log:3929:2016-11-08 04:14:43,105 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3931:2016-11-08 04:14:43,105 INFO [regionserver/node-5.cluster/192.168.124.6:16020-shortCompactions-1478577599683] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=130.7 M (48.5 M, 30.2 M, 52.0 M), priority=-3, time=730461673294373; duration=6sec ./node-5/hbase-root-regionserver-node-5.cluster.log:3934:2016-11-08 04:14:43,183 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13909, memsize=7.5 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/7de019354e6f4a49a6123bfbf003f5ff ./node-5/hbase-root-regionserver-node-5.cluster.log:3935:2016-11-08 04:14:43,450 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13909, memsize=14.0 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/4fa725e5ddaf4d74a3b9392d630d0cfe ./node-5/hbase-root-regionserver-node-5.cluster.log:3936:2016-11-08 04:14:43,677 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=13909, memsize=3.9 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/87f9679eb3404a248a0d4ebd2d386f63 ./node-5/hbase-root-regionserver-node-5.cluster.log:3937:2016-11-08 04:14:43,685 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/7de019354e6f4a49a6123bfbf003f5ff, entries=23492, sequenceid=13909, filesize=660.7 K ./node-5/hbase-root-regionserver-node-5.cluster.log:3938:2016-11-08 04:14:43,691 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/4fa725e5ddaf4d74a3b9392d630d0cfe, entries=70476, sequenceid=13909, filesize=1.4 M ./node-5/hbase-root-regionserver-node-5.cluster.log:3939:2016-11-08 04:14:43,697 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/87f9679eb3404a248a0d4ebd2d386f63, entries=23492, sequenceid=13909, filesize=432.6 K ./node-5/hbase-root-regionserver-node-5.cluster.log:3940:2016-11-08 04:14:43,699 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Finished memstore flush of ~25.45 MB/26686912, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 594ms, sequenceid=13909, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:3941:2016-11-08 04:14:43,700 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-5/hbase-root-regionserver-node-5.cluster.log:3942:2016-11-08 04:14:43,706 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:3943:2016-11-08 04:14:43,726 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:3944:2016-11-08 04:14:43,726 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:3945:2016-11-08 04:14:43,726 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:3946:2016-11-08 04:14:43,727 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:3947:2016-11-08 04:14:43,746 INFO [RS_CLOSE_REGION-node-5:16020-1] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3948:2016-11-08 04:14:43,767 INFO [PriorityRpcServer.handler=7,queue=1,port=16020] regionserver.RSRpcServices: Open IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3949:2016-11-08 04:14:43,816 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3950:2016-11-08 04:14:43,817 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3951:2016-11-08 04:14:43,821 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3952:2016-11-08 04:14:43,821 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3953:2016-11-08 04:14:44,112 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3954:2016-11-08 04:14:44,113 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3960:2016-11-08 04:14:44,223 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3961:2016-11-08 04:14:44,223 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3962:2016-11-08 04:14:44,224 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3963:2016-11-08 04:14:44,224 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3964:2016-11-08 04:14:44,225 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=32, currentSize=14732608, freeSize=12823979712, maxSize=12838712320, heapSize=14732608, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:3965:2016-11-08 04:14:44,225 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:3967:2016-11-08 04:14:44,273 INFO [RS_OPEN_REGION-node-5:16020-2] regionserver.HRegion: Onlined 393d2bfd8b1c52ce08540306659624f2; next sequenceid=13913 ./node-5/hbase-root-regionserver-node-5.cluster.log:3968:2016-11-08 04:14:44,275 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] regionserver.HRegionServer: Post open deploy tasks for IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:3976:2016-11-08 04:14:44,440 INFO [PostOpenDeployTasks:393d2bfd8b1c52ce08540306659624f2] hbase.MetaTableAccessor: Updated row IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. with server=node-5.cluster,16020,1478577464990 ./node-5/hbase-root-regionserver-node-5.cluster.log:4099:2016-11-08 04:14:53,759 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Close 393d2bfd8b1c52ce08540306659624f2, moving to node-3.cluster,16020,1478578389506 ./node-5/hbase-root-regionserver-node-5.cluster.log:4100:2016-11-08 04:14:53,759 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Running close preflush of IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:4110:2016-11-08 04:14:53,976 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14451, memsize=26.2 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/31c303df8f504c588eb0dee43b559225 ./node-5/hbase-root-regionserver-node-5.cluster.log:4118:2016-11-08 04:14:54,752 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14451, memsize=48.6 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/ea8ef733758f4f268b504392e12df69a ./node-5/hbase-root-regionserver-node-5.cluster.log:4119:2016-11-08 04:14:55,535 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14451, memsize=13.7 M, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/a65ad384f1084a22adfef1d0f03c4b88 ./node-5/hbase-root-regionserver-node-5.cluster.log:4120:2016-11-08 04:14:55,565 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/31c303df8f504c588eb0dee43b559225, entries=81642, sequenceid=14451, filesize=2.3 M ./node-5/hbase-root-regionserver-node-5.cluster.log:4121:2016-11-08 04:14:55,571 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/ea8ef733758f4f268b504392e12df69a, entries=244926, sequenceid=14451, filesize=5.1 M ./node-5/hbase-root-regionserver-node-5.cluster.log:4122:2016-11-08 04:14:55,578 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/a65ad384f1084a22adfef1d0f03c4b88, entries=81642, sequenceid=14451, filesize=1.6 M ./node-5/hbase-root-regionserver-node-5.cluster.log:4123:2016-11-08 04:14:55,583 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Finished memstore flush of ~88.45 MB/92745312, currentsize=2.20 MB/2303808 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 1824ms, sequenceid=14451, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:4125:2016-11-08 04:14:55,673 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14457, memsize=665.4 K, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/f6f3cfc7c8014cb1ac89eb4dcd2554df ./node-5/hbase-root-regionserver-node-5.cluster.log:4126:2016-11-08 04:14:55,828 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14457, memsize=1.2 M, hasBloomFilter=true, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/6c9298a7854f4c4bb1870822d60cfe94 ./node-5/hbase-root-regionserver-node-5.cluster.log:4127:2016-11-08 04:14:55,927 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.DefaultStoreFlusher: Flushed, sequenceid=14457, memsize=348.6 K, hasBloomFilter=false, into tmp file hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/.tmp/0d0ec5a00ca540b799536452944b3706 ./node-5/hbase-root-regionserver-node-5.cluster.log:4128:2016-11-08 04:14:55,945 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/big/f6f3cfc7c8014cb1ac89eb4dcd2554df, entries=2028, sequenceid=14457, filesize=48.5 K ./node-5/hbase-root-regionserver-node-5.cluster.log:4129:2016-11-08 04:14:55,949 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/meta/6c9298a7854f4c4bb1870822d60cfe94, entries=6084, sequenceid=14457, filesize=123.3 K ./node-5/hbase-root-regionserver-node-5.cluster.log:4130:2016-11-08 04:14:55,955 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HStore: Added hdfs://node-1.cluster/hbase/data/default/IntegrationTestBigLinkedList/393d2bfd8b1c52ce08540306659624f2/tiny/0d0ec5a00ca540b799536452944b3706, entries=2028, sequenceid=14457, filesize=38.8 K ./node-5/hbase-root-regionserver-node-5.cluster.log:4133:2016-11-08 04:14:55,963 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Finished memstore flush of ~2.20 MB/2303808, currentsize=0 B/0 for region IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. in 379ms, sequenceid=14457, compaction requested=true ./node-5/hbase-root-regionserver-node-5.cluster.log:4134:2016-11-08 04:14:55,980 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed GomnU ./node-5/hbase-root-regionserver-node-5.cluster.log:4135:2016-11-08 04:14:55,988 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed big ./node-5/hbase-root-regionserver-node-5.cluster.log:4136:2016-11-08 04:14:55,989 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed meta ./node-5/hbase-root-regionserver-node-5.cluster.log:4137:2016-11-08 04:14:55,989 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed nwmrW ./node-5/hbase-root-regionserver-node-5.cluster.log:4138:2016-11-08 04:14:55,989 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed piwbr ./node-5/hbase-root-regionserver-node-5.cluster.log:4139:2016-11-08 04:14:55,991 INFO [StoreCloserThread-IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2.-1] regionserver.HStore: Closed tiny ./node-5/hbase-root-regionserver-node-5.cluster.log:4140:2016-11-08 04:14:56,007 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegion: Closed IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2. ./node-5/hbase-root-regionserver-node-5.cluster.log:4141:2016-11-08 04:14:56,007 INFO [RS_CLOSE_REGION-node-5:16020-2] regionserver.HRegionServer: Adding moved region record: 393d2bfd8b1c52ce08540306659624f2 to node-3.cluster,16020,1478578389506 as of 14457 ./node-5/hbase-root-regionserver-node-5.cluster.log:4250:2016-11-08 04:17:16,238 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=big, fileCount=8, fileSize=273.2 M, priority=1, time=730345790464503; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:4251:2016-11-08 04:17:16,238 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=meta, fileCount=3, fileSize=88.5 M, priority=1, time=730345801175673; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:4252:2016-11-08 04:17:16,238 INFO [regionserver/node-5.cluster/192.168.124.6:16020-longCompactions-1478577468362] regionserver.CompactSplitThread: Aborted compaction: Request = regionName=IntegrationTestBigLinkedList,,1478577020916.393d2bfd8b1c52ce08540306659624f2., storeName=tiny, fileCount=3, fileSize=31.7 M, priority=1, time=730345803938360; duration=0sec ./node-5/hbase-root-regionserver-node-5.cluster.log:5149:2016-11-08 04:29:37,451 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for GomnU: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5150:2016-11-08 04:29:37,462 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:5151:2016-11-08 04:29:37,491 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for big: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5152:2016-11-08 04:29:37,492 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:5157:2016-11-08 04:29:37,857 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for meta: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5158:2016-11-08 04:29:37,857 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:5160:2016-11-08 04:29:38,238 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for nwmrW: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5161:2016-11-08 04:29:38,238 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:5162:2016-11-08 04:29:38,245 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for piwbr: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5163:2016-11-08 04:29:38,245 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000 ./node-5/hbase-root-regionserver-node-5.cluster.log:5164:2016-11-08 04:29:38,250 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] hfile.CacheConfig: Created cacheConfig for tiny: blockCache=LruBlockCache{blockCount=0, currentSize=13166056, freeSize=12825546264, maxSize=12838712320, heapSize=13166056, minSize=12196776960, minFactor=0.95, multiSize=6098388480, multiFactor=0.5, singleSize=3049194240, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false ./node-5/hbase-root-regionserver-node-5.cluster.log:5165:2016-11-08 04:29:38,251 INFO [StoreOpener-393d2bfd8b1c52ce08540306659624f2-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000