[MESOS-9560] ContentType/AgentAPITest.MarkResourceProviderGone/1 is flaky

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: test
• Labels: flaky flaky-test mesosphere storage test
• Sprint: Storage R11 Sprint 40, Storage: RI-14 Sprint 46, Storage: RI-17 Sprint 52
• Story Points: 5
• Assignee: Benjamin Bannier
• Reporter: Benjamin Bannier
• Shepherd: Chun-Hung Hsiao
• Created: 07/Feb/19 07:25
• Updated: 13/Aug/19 14:56
• Resolved: 13/Aug/19 14:56

Description

We observed a segfault in ContentType/AgentAPITest.MarkResourceProviderGone/1 on test teardown.

I0131 23:55:59.378453  6798 slave.cpp:923] Agent terminating
I0131 23:55:59.378813 31143 master.cpp:1269] Agent a27bcaba-70cc-4ec3-9786-38f9512c61fd-S0 at slave(1112)@172.16.10.236:43229 (ip-172-16-10-236.ec2.internal) disconnected
I0131 23:55:59.378831 31143 master.cpp:3272] Disconnecting agent a27bcaba-70cc-4ec3-9786-38f9512c61fd-S0 at slave(1112)@172.16.10.236:43229 (ip-172-16-10-236.ec2.internal)
I0131 23:55:59.378846 31143 master.cpp:3291] Deactivating agent a27bcaba-70cc-4ec3-9786-38f9512c61fd-S0 at slave(1112)@172.16.10.236:43229 (ip-172-16-10-236.ec2.internal)
I0131 23:55:59.378891 31143 hierarchical.cpp:793] Agent a27bcaba-70cc-4ec3-9786-38f9512c61fd-S0 deactivated
F0131 23:55:59.378891 31149 logging.cpp:67] RAW: Pure virtual method called
    @     0x7f633aaaebdd  google::LogMessage::Fail()
    @     0x7f633aab6281  google::RawLog__()
    @     0x7f6339821262  __cxa_pure_virtual
    @     0x55671cacc113  testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith()
    @     0x55671b532e78  mesos::internal::tests::resource_provider::MockResourceProvider<>::disconnected()
    @     0x7f633978f6b0  process::AsyncExecutorProcess::execute<>()
    @     0x7f633979f218  _ZN5cpp176invokeIZN7process8dispatchI7NothingNS1_20AsyncExecutorProcessERKSt8functionIFvvEES9_EENS1_6FutureIT_EERKNS1_3PIDIT0_EEMSE_FSB_T1_EOT2_EUlSt10unique_ptrINS1_7PromiseIS3_EESt14default_deleteISP_EEOS7_PNS1_11ProcessBaseEE_JSS_S7_SV_EEEDTclcl7forwardISB_Efp_Espcl7forwardIT0_Efp0_EEEOSB_DpOSX_
    @     0x7f633a9f5d01  process::ProcessBase::consume()
    @     0x7f633aa1a08a  process::ProcessManager::resume()
    @     0x7f633aa1db06  _ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv
    @     0x7f633acc9f80  execute_native_thread_routine
    @     0x7f6337142e25  start_thread
    @     0x7f6336241bad  __clone

Issue Links

• is duplicated by: MESOS-9903 ContentType/AgentAPITest.MarkResourceProviderGone is flaky.
• is related to: MESOS-9904 ExecutorHttpApiTest.HeartbeatCalls is flaky
• is related to: MESOS-8096 Enqueueing events in MockHTTPScheduler can lead to segfaults.
• relates to: MESOS-9905 Two unit tests in `DefaultExecutorTest` are flaky