2015-06-15 15:58:21,239 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer0x0, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2015-06-15 15:58:21,240 DEBUG [main] zookeeper.RecoverableZooKeeper(595): Node /hbase already exists 2015-06-15 15:58:21,241 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(592): mockedServer-0x14df970ebdc0018 connected 2015-06-15 15:58:21,246 DEBUG [Thread-121] executor.ExecutorService(99): Starting executor service name=MASTER_OPEN_REGION-mockedAMExecutor, corePoolSize=3, maxPoolSize=3 2015-06-15 15:58:21,247 DEBUG [Thread-121] executor.ExecutorService(99): Starting executor service name=MASTER_CLOSE_REGION-mockedAMExecutor, corePoolSize=3, maxPoolSize=3 2015-06-15 15:58:21,247 DEBUG [Thread-121] executor.ExecutorService(99): Starting executor service name=MASTER_SERVER_OPERATIONS-mockedAMExecutor, corePoolSize=3, maxPoolSize=3 2015-06-15 15:58:21,247 DEBUG [Thread-121] executor.ExecutorService(99): Starting executor service name=MASTER_META_SERVER_OPERATIONS-mockedAMExecutor, corePoolSize=3, maxPoolSize=3 2015-06-15 15:58:21,249 INFO [Thread-121] master.RegionStates(1112): Transition null to {e87bbed599bed2950d75b6f7528c0349 state=OPEN, ts=1434409101249, server=example.org,1234,5678} 2015-06-15 15:58:21,249 DEBUG [Thread-121] master.RegionStates(460): Onlined e87bbed599bed2950d75b6f7528c0349 on example.org,1234,5678 {ENCODED => e87bbed599bed2950d75b6f7528c0349, NAME => 't,,1434409036078.e87bbed599bed2950d75b6f7528c0349.', STARTKEY => '', ENDKEY => ''} 2015-06-15 15:58:21,249 DEBUG [Thread-121] master.AssignmentManager(2470): Starting unassign of t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. (offlining), current state: {e87bbed599bed2950d75b6f7528c0349 state=OPEN, ts=1434409101249, server=example.org,1234,5678} 2015-06-15 15:58:21,250 DEBUG [Thread-121] zookeeper.ZKAssign(527): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Creating unassigned node e87bbed599bed2950d75b6f7528c0349 in a CLOSING state 2015-06-15 15:58:21,251 DEBUG [Thread-89-EventThread] zookeeper.ZooKeeperWatcher(508): master:54601-0x14df970ebdc0017, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2015-06-15 15:58:21,251 INFO [Thread-121] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=OPEN, ts=1434409101249, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101251, server=example.org,1234,5678} 2015-06-15 15:58:21,252 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,252 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,252 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,253 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,253 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,253 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,254 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,254 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,254 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,255 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,255 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,255 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,256 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,256 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,256 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,256 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,257 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,257 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,257 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,258 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,258 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,258 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,258 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,259 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,259 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,259 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,260 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,260 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,260 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,261 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,261 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,261 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,261 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,262 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,262 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,262 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,263 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,263 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,263 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,263 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,264 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,264 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,264 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,264 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,265 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,265 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,265 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,266 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,266 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,266 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,267 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,267 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,268 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,268 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,268 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,269 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,269 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,270 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,270 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,270 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,271 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,271 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,272 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,272 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,272 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,273 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,273 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,273 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,274 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,274 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,274 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,275 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,275 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,275 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,275 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,276 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,276 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,276 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,277 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,277 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,277 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,277 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,278 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,278 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,278 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,279 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,279 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,279 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,280 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,281 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,281 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,281 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,282 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,282 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,282 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,283 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,283 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,283 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,284 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,284 WARN [Thread-121] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,284 WARN [Thread-121] master.RegionStates(1103): Failed to open/close e87bbed599bed2950d75b6f7528c0349 on example.org,1234,5678, set to FAILED_CLOSE 2015-06-15 15:58:21,284 INFO [Thread-121] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101251, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101284, server=example.org,1234,5678} 2015-06-15 15:58:21,291 WARN [RunAmJoinCluster] master.RegionStates(339): Tried to create a state for a region already in RegionStates, used existing: {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101284, server=example.org,1234,5678}, ignored new: OPEN 2015-06-15 15:58:21,292 DEBUG [RunAmJoinCluster] master.AssignmentManager(540): Found {ENCODED => e87bbed599bed2950d75b6f7528c0349, NAME => 't,,1434409036078.e87bbed599bed2950d75b6f7528c0349.', STARTKEY => '', ENDKEY => ''} out on cluster 2015-06-15 15:58:21,292 INFO [RunAmJoinCluster] master.AssignmentManager(623): Found regions out on cluster or in RIT; presuming failover 2015-06-15 15:58:21,293 INFO [RunAmJoinCluster] master.AssignmentManager(767): Processing e87bbed599bed2950d75b6f7528c0349 in state: M_ZK_REGION_CLOSING 2015-06-15 15:58:21,293 INFO [RunAmJoinCluster] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101284, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=CLOSING, ts=1434409101293, server=example.org,1234,5678} 2015-06-15 15:58:21,294 INFO [Thread-121] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101284, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101294, server=example.org,1234,5678} 2015-06-15 15:58:21,294 INFO [RunAmJoinCluster] master.AssignmentManager(898): Processed region e87bbed599bed2950d75b6f7528c0349 in state M_ZK_REGION_CLOSING, on server: example.org,1234,5678 2015-06-15 15:58:21,294 DEBUG [Thread-121] zookeeper.ZKAssign(805): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioning e87bbed599bed2950d75b6f7528c0349 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2015-06-15 15:58:21,295 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,295 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,296 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,296 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,296 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,297 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,296 DEBUG [Thread-121] zookeeper.ZKAssign(880): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioned node e87bbed599bed2950d75b6f7528c0349 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED 2015-06-15 15:58:21,297 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,297 INFO [RunAmJoinCluster] master.AssignmentManager(499): Joined the cluster in 12ms, failover=true 2015-06-15 15:58:21,298 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,298 DEBUG [AM.ZK.Worker-pool62-t1] master.AssignmentManager(954): Handling RS_ZK_REGION_CLOSED, server=example.org,1234,5678, region=e87bbed599bed2950d75b6f7528c0349, current_state={e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101294, server=example.org,1234,5678} 2015-06-15 15:58:21,298 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,299 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,299 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,300 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,300 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,300 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,301 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,301 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,301 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,302 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,302 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,302 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,303 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,303 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,303 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,304 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,304 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,304 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,304 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,305 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,305 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,305 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,306 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,306 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,306 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,307 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,307 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,307 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,307 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,308 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,308 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,308 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,309 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,309 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,309 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,309 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,310 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,310 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,311 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,311 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,311 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,312 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,312 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,312 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,312 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,313 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,313 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,313 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,314 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,314 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,314 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,315 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,315 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,315 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,315 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,316 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,316 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,316 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,317 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,317 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,317 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,317 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,318 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,318 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,318 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,319 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,319 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,319 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,320 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,320 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,320 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,320 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,321 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,321 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,321 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,322 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,322 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,322 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,323 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,323 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,323 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,323 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,324 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,324 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,324 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,325 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,325 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,325 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,326 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,326 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,326 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,327 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,327 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.AssignmentManager(1866): Server example.org,1234,5678 region CLOSE RPC returned false for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. 2015-06-15 15:58:21,327 WARN [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.RegionStates(1103): Failed to open/close e87bbed599bed2950d75b6f7528c0349 on example.org,1234,5678, set to FAILED_CLOSE 2015-06-15 15:58:21,328 INFO [MASTER_SERVER_OPERATIONS-mockedAMExecutor-0] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101294, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101328, server=example.org,1234,5678} 2015-06-15 15:58:21,328 WARN [AM.ZK.Worker-pool62-t1] master.AssignmentManager(975): Region state changed from {e87bbed599bed2950d75b6f7528c0349 state=PENDING_CLOSE, ts=1434409101294, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101328, server=example.org,1234,5678}, while acquiring lock 2015-06-15 15:58:21,328 DEBUG [AM.ZK.Worker-pool62-t1] handler.ClosedRegionHandler(93): Handling CLOSED event for e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,328 INFO [AM.ZK.Worker-pool62-t1] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=FAILED_CLOSE, ts=1434409101328, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=CLOSED, ts=1434409101328, server=example.org,1234,5678} 2015-06-15 15:58:21,329 DEBUG [AM.ZK.Worker-pool62-t1] master.AssignmentManager(2381): Found an existing plan for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. destination server is example.org,0,5678 accepted as a dest server = true 2015-06-15 15:58:21,329 DEBUG [AM.ZK.Worker-pool62-t1] master.AssignmentManager(2419): Using pre-existing plan for t,,1434409036078.e87bbed599bed2950d75b6f7528c0349.; plan=hri=t,,1434409036078.e87bbed599bed2950d75b6f7528c0349., src=, dest=example.org,0,5678 2015-06-15 15:58:21,330 INFO [AM.ZK.Worker-pool62-t1] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=CLOSED, ts=1434409101328, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=OFFLINE, ts=1434409101330, server=example.org,1234,5678} 2015-06-15 15:58:21,330 DEBUG [AM.ZK.Worker-pool62-t1] zookeeper.ZKAssign(205): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Creating (or updating) unassigned node e87bbed599bed2950d75b6f7528c0349 with OFFLINE state 2015-06-15 15:58:21,332 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,333 INFO [AM.ZK.Worker-pool62-t1] master.AssignmentManager(2122): Assigning t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. to example.org,0,5678 2015-06-15 15:58:21,333 INFO [AM.ZK.Worker-pool62-t1] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=OFFLINE, ts=1434409101330, server=example.org,1234,5678} to {e87bbed599bed2950d75b6f7528c0349 state=PENDING_OPEN, ts=1434409101333, server=example.org,0,5678} 2015-06-15 15:58:21,334 DEBUG [Thread-121] zookeeper.ZKAssign(805): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioning e87bbed599bed2950d75b6f7528c0349 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2015-06-15 15:58:21,335 DEBUG [AM.ZK.Worker-pool62-t2] master.AssignmentManager(954): Handling M_ZK_REGION_OFFLINE, server=example.org,0,5678, region=e87bbed599bed2950d75b6f7528c0349, current_state={e87bbed599bed2950d75b6f7528c0349 state=PENDING_OPEN, ts=1434409101333, server=example.org,0,5678} 2015-06-15 15:58:21,335 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,335 DEBUG [Thread-121] zookeeper.ZKAssign(880): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioned node e87bbed599bed2950d75b6f7528c0349 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2015-06-15 15:58:21,336 DEBUG [Thread-121] zookeeper.ZKAssign(805): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioning e87bbed599bed2950d75b6f7528c0349 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2015-06-15 15:58:21,337 DEBUG [AM.ZK.Worker-pool62-t3] master.AssignmentManager(954): Handling RS_ZK_REGION_OPENING, server=example.org,0,5678, region=e87bbed599bed2950d75b6f7528c0349, current_state={e87bbed599bed2950d75b6f7528c0349 state=PENDING_OPEN, ts=1434409101333, server=example.org,0,5678} 2015-06-15 15:58:21,337 INFO [AM.ZK.Worker-pool62-t3] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=PENDING_OPEN, ts=1434409101333, server=example.org,0,5678} to {e87bbed599bed2950d75b6f7528c0349 state=OPENING, ts=1434409101337, server=example.org,0,5678} 2015-06-15 15:58:21,337 DEBUG [Thread-121] zookeeper.ZKAssign(880): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Transitioned node e87bbed599bed2950d75b6f7528c0349 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2015-06-15 15:58:21,337 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,338 DEBUG [Thread-121] zookeeper.ZKAssign(1016): Waiting on RIT: [e87bbed599bed2950d75b6f7528c0349] 2015-06-15 15:58:21,339 DEBUG [AM.ZK.Worker-pool62-t4] master.AssignmentManager(954): Handling RS_ZK_REGION_OPENED, server=example.org,0,5678, region=e87bbed599bed2950d75b6f7528c0349, current_state={e87bbed599bed2950d75b6f7528c0349 state=OPENING, ts=1434409101337, server=example.org,0,5678} 2015-06-15 15:58:21,339 INFO [AM.ZK.Worker-pool62-t4] master.RegionStates(1112): Transition {e87bbed599bed2950d75b6f7528c0349 state=OPENING, ts=1434409101337, server=example.org,0,5678} to {e87bbed599bed2950d75b6f7528c0349 state=OPEN, ts=1434409101339, server=example.org,0,5678} 2015-06-15 15:58:21,340 DEBUG [AM.ZK.Worker-pool62-t4] coordination.ZkOpenRegionCoordination(350): Handling OPENED of e87bbed599bed2950d75b6f7528c0349 from master,1,1; deleting unassigned node 2015-06-15 15:58:21,341 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e87bbed599bed2950d75b6f7528c0349 2015-06-15 15:58:21,341 DEBUG [AM.ZK.Worker-pool62-t4] zookeeper.ZKAssign(479): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Deleted unassigned node e87bbed599bed2950d75b6f7528c0349 in expected state RS_ZK_REGION_OPENED 2015-06-15 15:58:21,341 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(508): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2015-06-15 15:58:21,342 DEBUG [AM.ZK.Worker-pool62-t5] master.AssignmentManager$4(1343): Znode t,,1434409036078.e87bbed599bed2950d75b6f7528c0349. deleted, state: {e87bbed599bed2950d75b6f7528c0349 state=OPEN, ts=1434409101339, server=example.org,0,5678} 2015-06-15 15:58:21,342 DEBUG [AM.ZK.Worker-pool62-t5] master.RegionStates(460): Onlined e87bbed599bed2950d75b6f7528c0349 on example.org,0,5678 {ENCODED => e87bbed599bed2950d75b6f7528c0349, NAME => 't,,1434409036078.e87bbed599bed2950d75b6f7528c0349.', STARTKEY => '', ENDKEY => ''} 2015-06-15 15:58:21,343 INFO [AM.ZK.Worker-pool62-t5] master.RegionStates(472): Offlined e87bbed599bed2950d75b6f7528c0349 from example.org,1234,5678 2015-06-15 15:58:21,443 DEBUG [main] zookeeper.ZKAssign(497): mockedServer-0x14df970ebdc0018, quorum=localhost:61627, baseZNode=/hbase Deleting any existing unassigned nodes