I0829 00:57:44.994989  3941 tablet_service.cc:764] Processing CreateTablet for tablet 07e4b47e517a4d44b1b8cbdaed95e216 (table=test_table [id=3f09771d7fd64045b69d22567fe25628]), partition=RANGE (key) PARTITION 43 <= VALUES < 44
I0829 00:57:45.025722  3876 ts_tablet_manager.cc:941] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Registered tablet (data state: TABLET_DATA_READY)
I0829 00:57:45.207020  3886 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216" candidate_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be496979d354f8ca605cc5bb7a845a1" is_pre_election: true
I0829 00:57:45.207049  4020 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216" candidate_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" is_pre_election: true
I0829 00:57:45.208861  4020 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216" candidate_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4"
I0829 00:57:45.208967  3886 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216" candidate_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be496979d354f8ca605cc5bb7a845a1"
I0829 00:57:45.211050  3803 catalog_manager.cc:2579] T 07e4b47e517a4d44b1b8cbdaed95e216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15c9ce73e94d4ba9b0555e8b3b80337b (127.14.194.2). New cstate: current_term: 1 leader_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be496979d354f8ca605cc5bb7a845a1" member_type: VOTER last_known_addr { host: "127.14.194.1" port: 48464 } } peers { permanent_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" member_type: VOTER last_known_addr { host: "127.14.194.2" port: 47436 } } peers { permanent_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" member_type: VOTER last_known_addr { host: "127.14.194.3" port: 57528 } } }
I0829 00:57:45.256232  4062 ts_tablet_manager.cc:791] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Bootstrapping tablet
I0829 00:57:45.257331  4062 tablet_bootstrap.cc:433] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Bootstrap starting.
I0829 00:57:45.257793  4062 tablet_bootstrap.cc:568] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: No blocks or log segments found. Creating new log.
I0829 00:57:45.259057  4062 tablet_bootstrap.cc:433] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: No bootstrap required, opened a new log
I0829 00:57:45.259096  4062 ts_tablet_manager.cc:816] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.004s
I0829 00:57:45.259335  4062 raft_consensus.cc:287] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be496979d354f8ca605cc5bb7a845a1" member_type: VOTER last_known_addr { host: "127.14.194.1" port: 48464 } } peers { permanent_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" member_type: VOTER last_known_addr { host: "127.14.194.2" port: 47436 } } peers { permanent_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" member_type: VOTER last_known_addr { host: "127.14.194.3" port: 57528 } }
I0829 00:57:45.259347  4062 raft_consensus.cc:313] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I0829 00:57:45.259374  4062 raft_consensus.cc:576] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be496979d354f8ca605cc5bb7a845a1, State: Initialized, Role: FOLLOWER
I0829 00:57:45.259393  4062 consensus_queue.cc:191] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER
I0829 00:57:45.259604  4062 ts_tablet_manager.cc:844] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
  tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216"
    07e4b47e517a4d44b1b8cbdaed95e216: consensus_state { current_term: 1 leader_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be496979d354f8ca605cc5bb7a845a1" member_type: VOTER last_known_addr { host: "127.14.194.1" port: 48464 } } peers { permanent_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" member_type: VOTER last_known_addr { host: "127.14.194.2" port: 47436 } } peers { permanent_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" member_type: VOTER last_known_addr { host: "127.14.194.3" port: 57528 } } } } state: RUNNING state_msg: "Tablet reported with an active leader" table_id: "3f09771d7fd64045b69d22567fe25628" partition { partition_key_start: "\200\000\000+" partition_key_end: "\200\000\000," }
I0829 00:57:45.687356  3801 catalog_manager.cc:3516] T 00000000000000000000000000000000 P 3c2dfa351f91465fa0f98f97083580b5: Sending DeleteTablet for 3 replicas of tablet 07e4b47e517a4d44b1b8cbdaed95e216
I0829 00:57:45.687372  3801 catalog_manager.cc:3173] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 07e4b47e517a4d44b1b8cbdaed95e216 on 6be496979d354f8ca605cc5bb7a845a1 (127.14.194.1:48464) (Table deleted at 2017-08-29 00:57:45 UTC)
I0829 00:57:45.706707  3803 catalog_manager.cc:2442] Got report from deleted tablet 07e4b47e517a4d44b1b8cbdaed95e216 (table test_table [id=3f09771d7fd64045b69d22567fe25628]) (Table deleted at 2017-08-29 00:57:45 UTC): Sending delete request for this tablet
I0829 00:57:45.757628  4109 raft_consensus.cc:412] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I0829 00:57:45.757654  4109 raft_consensus.cc:2456] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Snoozing failure detection for 1.830s (starting election)
I0829 00:57:45.757697  4109 raft_consensus.cc:434] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be496979d354f8ca605cc5bb7a845a1" member_type: VOTER last_known_addr { host: "127.14.194.1" port: 48464 } } peers { permanent_uuid: "15c9ce73e94d4ba9b0555e8b3b80337b" member_type: VOTER last_known_addr { host: "127.14.194.2" port: 47436 } } peers { permanent_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" member_type: VOTER last_known_addr { host: "127.14.194.3" port: 57528 } }
I0829 00:57:45.762008  4005 tablet_service.cc:805] Processing DeleteTablet for tablet 07e4b47e517a4d44b1b8cbdaed95e216 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-08-29 00:57:45 UTC) from {username='slave'} at 127.0.0.1:37169
I0829 00:57:45.772285  3877 tablet_service.cc:805] Processing DeleteTablet for tablet 07e4b47e517a4d44b1b8cbdaed95e216 with delete_type TABLET_DATA_DELETED (Table deleted at 2017-08-29 00:57:45 UTC) from {username='slave'} at 127.0.0.1:40636
I0829 00:57:45.772315  3877 tablet_replica.cc:237] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: stopping tablet replica
I0829 00:57:45.772332  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op CompactRowSetsOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772339  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op MinorDeltaCompactionOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772405  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op MajorDeltaCompactionOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772414  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op UndoDeltaBlockGCOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772441  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op FlushMRSOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772449  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op FlushDeltaMemStoresOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.772456  3877 maintenance_manager.cc:229] P 6be496979d354f8ca605cc5bb7a845a1: Unregistered op LogGCOp(07e4b47e517a4d44b1b8cbdaed95e216)
I0829 00:57:45.809599  4109 leader_election.cc:221] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer 15c9ce73e94d4ba9b0555e8b3b80337b
I0829 00:57:45.809659  4109 leader_election.cc:221] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [CANDIDATE]: Term 1 pre-election: Requesting pre-vote from peer cb4514dde0a34e02ac350b06d4bbe2d4
I0829 00:57:45.809954  4019 tablet_service.cc:1002] Received RequestConsensusVote() RPC: tablet_id: "07e4b47e517a4d44b1b8cbdaed95e216" candidate_uuid: "6be496979d354f8ca605cc5bb7a845a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb4514dde0a34e02ac350b06d4bbe2d4" is_pre_election: true
W0829 00:57:45.810178  3852 leader_election.cc:283] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb4514dde0a34e02ac350b06d4bbe2d4: Illegal state: must be running to vote when last-logged opid is not known
I0829 00:57:45.810921  3877 raft_consensus.cc:1807] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Raft consensus shutting down.
I0829 00:57:45.812129  3877 raft_consensus.cc:1834] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [term 0 FOLLOWER]: Raft consensus is shut down!
I0829 00:57:45.812340  3877 ts_tablet_manager.cc:1095] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I0829 00:57:45.813349  3877 ts_tablet_manager.cc:1107] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: tablet deleted: last-logged OpId: 0.0
I0829 00:57:45.813379  3877 log.cc:960] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Deleting WAL directory at /tmp/run_tha_testAyF2t9/test-tmp/create-table-stress-test.CreateTableStressTest.CreateAndDeleteBigTable.1503968264654339-3778/minicluster-data/ts-0-root/wals/07e4b47e517a4d44b1b8cbdaed95e216
I0829 00:57:45.813491  3877 ts_tablet_manager.cc:1125] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Deleting consensus metadata
I0829 00:57:45.814038  3786 catalog_manager.cc:3151] TS 6be496979d354f8ca605cc5bb7a845a1 (127.14.194.1:48464): tablet 07e4b47e517a4d44b1b8cbdaed95e216 (table test_table [id=3f09771d7fd64045b69d22567fe25628]) successfully deleted
W0829 00:57:45.816220  3852 leader_election.cc:283] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15c9ce73e94d4ba9b0555e8b3b80337b: Not found: Tablet not found: 07e4b47e517a4d44b1b8cbdaed95e216
I0829 00:57:45.816237  3852 leader_election.cc:248] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost.
W0829 00:57:45.816279  3852 raft_consensus.cc:2180] T 07e4b47e517a4d44b1b8cbdaed95e216 P 6be496979d354f8ca605cc5bb7a845a1: Unable to run election callback: Service unavailable: Thread pool token was shut down
F0829 00:57:45.816316  3852 thread_restrictions.cc:79] Check failed: LoadTLS()->wait_allowed Waiting is not allowed to be used on this thread to prevent server-wide latency aberrations and deadlocks. Thread 3852 (name: "rpc reactor", category: "reactor")
*** Check failure stack trace: ***
    @     0x7fcfc7bae62d  google::LogMessage::Fail() at ??:0
    @     0x7fcfc7bb064c  google::LogMessage::SendToLog() at ??:0
    @     0x7fcfc7bae189  google::LogMessage::Flush() at ??:0
    @     0x7fcfc7bb0fdf  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7fcfc8864507  kudu::ThreadRestrictions::AssertWaitAllowed() at ??:0
    @     0x7fcfc55de12f  kudu::consensus::RaftConsensus::Stop() at ??:0
    @     0x7fcfc55de6aa  kudu::consensus::RaftConsensus::Shutdown() at ??:0
    @     0x7fcfc55cdba4  kudu::consensus::RaftConsensus::~RaftConsensus() at ??:0
    @     0x7fcfc55fab95  __gnu_cxx::new_allocator<>::destroy<>() at ??:0
    @     0x7fcfc55fab47  std::allocator_traits<>::_S_destroy<>() at ??:0
    @     0x7fcfc55faae9  std::allocator_traits<>::destroy<>() at ??:0
    @     0x7fcfc55fa91b  std::_Sp_counted_ptr_inplace<>::_M_dispose() at ??:0
    @           0x4304fa  std::_Sp_counted_base<>::_M_release() at /usr/include/c++/4.8/bits/shared_ptr_base.h:158
    @           0x42e68f  std::__shared_count<>::~__shared_count() at /usr/include/c++/4.8/bits/shared_ptr_base.h:547
    @     0x7fcfcb8a4032  std::__shared_ptr<>::~__shared_ptr() at ??:0
    @     0x7fcfcb8a4072  std::shared_ptr<>::~shared_ptr() at ??:0
    @     0x7fcfc55ed4d4  std::_Head_base<>::~_Head_base() at ??:0
    @     0x7fcfc55ed4f2  _ZNSt11_Tuple_implILm0EJSt10shared_ptrIN4kudu9consensus13RaftConsensusEENS3_14ElectionReasonESt12_PlaceholderILi1EEEED1Ev at ??:0
    @     0x7fcfc55ed50c  std::tuple<>::~tuple() at ??:0
    @     0x7fcfc55ed52a  std::_Bind<>::~_Bind() at ??:0
    @     0x7fcfc55f6162  std::_Function_base::_Base_manager<>::_M_destroy() at ??:0
    @     0x7fcfc55f34ed  std::_Function_base::_Base_manager<>::_M_manager() at ??:0
    @     0x7fcfcbe5d5c5  std::_Function_base::~_Function_base() at ??:0
    @     0x7fcfc55b0d18  std::function<>::~function() at ??:0
    @     0x7fcfc55add9d  kudu::consensus::LeaderElection::~LeaderElection() at ??:0
    @     0x7fcfc55b699a  kudu::RefCountedThreadSafe<>::DeleteInternal() at ??:0
    @     0x7fcfc55b697a  kudu::DefaultRefCountedThreadSafeTraits<>::Destruct() at ??:0
    @     0x7fcfc55b6960  kudu::RefCountedThreadSafe<>::Release() at ??:0
    @     0x7fcfc55b6936  kudu::internal::MaybeRefcount<>::Release() at ??:0
    @     0x7fcfc55b68c4  kudu::internal::BindState<>::~BindState() at ??:0
    @     0x7fcfc55b6910  kudu::internal::BindState<>::~BindState() at ??:0
    @     0x7fcfcb44f23d  kudu::RefCountedThreadSafe<>::DeleteInternal() at ??:0