kernel:[47684505.918928] Dazed and confused, but trying to continue 2019-01-18,12:26:45,996 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:26:45,996 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:45,996 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:26:46,187 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 191 (ms) 2019-01-18,12:26:46,187 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 191 (ms) 2019-01-18,12:26:46,283 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:26:46,283 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:46,283 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:26:46,477 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 194 (ms) 2019-01-18,12:26:46,477 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 194 (ms) 2019-01-18,12:26:51,362 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 3 (ms) 2019-01-18,12:26:51,362 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:51,362 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:26:51,552 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 190 (ms) 2019-01-18,12:26:51,552 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 193 (ms) 2019-01-18,12:26:51,640 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:26:51,640 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:51,640 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:26:51,840 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 200 (ms) 2019-01-18,12:26:51,840 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 200 (ms) 2019-01-18,12:26:57,147 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:26:57,147 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:57,148 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 1 (ms) 2019-01-18,12:26:57,157 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:26:57,157 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:26:57,157 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:26:57,348 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 200 (ms) 2019-01-18,12:26:57,348 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 201 (ms) 2019-01-18,12:26:57,356 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 199 (ms) 2019-01-18,12:26:57,356 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 199 (ms) 2019-01-18,12:27:02,286 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:02,286 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:02,286 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:02,403 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:02,403 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:02,403 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:02,473 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 187 (ms) 2019-01-18,12:27:02,473 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 187 (ms) 2019-01-18,12:27:02,594 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 191 (ms) 2019-01-18,12:27:02,594 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 191 (ms) 2019-01-18,12:27:07,478 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:07,478 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:07,478 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:07,600 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:07,600 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:07,600 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:07,665 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 187 (ms) 2019-01-18,12:27:07,665 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 187 (ms) 2019-01-18,12:27:07,795 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 195 (ms) 2019-01-18,12:27:07,795 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 195 (ms) 2019-01-18,12:27:12,706 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:12,706 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:12,706 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:12,905 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 199 (ms) 2019-01-18,12:27:12,905 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 199 (ms) 2019-01-18,12:27:13,643 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:13,643 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:13,643 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:13,858 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 215 (ms) 2019-01-18,12:27:13,858 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 215 (ms) 2019-01-18,12:27:17,308 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 1 (ms) 2019-01-18,12:27:17,308 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:17,308 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:17,489 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 181 (ms) 2019-01-18,12:27:17,489 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 182 (ms) 2019-01-18,12:27:17,677 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:17,677 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:17,677 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:17,862 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 185 (ms) 2019-01-18,12:27:17,862 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 185 (ms) 2019-01-18,12:27:23,141 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:23,141 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 1 (ms) 2019-01-18,12:27:23,141 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:23,209 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:23,209 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:23,209 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:23,325 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 184 (ms) 2019-01-18,12:27:23,325 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 185 (ms) 2019-01-18,12:27:23,408 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 199 (ms) 2019-01-18,12:27:23,408 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 199 (ms) 2019-01-18,12:27:27,890 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 1 (ms) 2019-01-18,12:27:27,890 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:27,890 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:27,970 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:27,970 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:27,970 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:28,071 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 181 (ms) 2019-01-18,12:27:28,071 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 182 (ms) 2019-01-18,12:27:28,165 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 195 (ms) 2019-01-18,12:27:28,165 INFO [MemStoreFlusher.0] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 195 (ms) 2019-01-18,12:27:31,971 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Grab the write lock cost: 0 (ms) 2019-01-18,12:27:31,971 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> wait the mvcc cost: 0 (ms) 2019-01-18,12:27:31,971 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> append the flush maker cost: 0 (ms) 2019-01-18,12:27:32,148 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: ----> Take the snapshot cost: 177 (ms) 2019-01-18,12:27:32,148 INFO [MemStoreFlusher.1] org.apache.hadoop.hbase.regionserver.HRegion: --> Memstore snapshotting cost: 177 (ms)