Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-9905

Two unit tests in `DefaultExecutorTest` are flaky

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None

    Description

      We observed segfault in `MesosContainerizer/DefaultExecutorTest.TaskWithFileURI/0` and `MesosContainerizer/DefaultExecutorTest.ROOT_ContainerStatusForTask/0`.

      // MesosContainerizer/DefaultExecutorTest.TaskWithFileURI/0
      
      22:47:07 PC: @     0x7fb0c4ec7d76 mesos::v1::scheduler::Mesos::send()
      22:47:07 *** SIGSEGV (@0x0) received by PID 26068 (TID 0x7fb0b9679700) from PID 0; stack trace: ***
      22:47:07     @     0x7fb08f0dcde7 (unknown)
      22:47:07     @     0x7fb08f0e4385 JVM_handle_linux_signal
      22:47:07     @     0x7fb08f0d9583 (unknown)
      22:47:07     @     0x7fb0c268e7e0 (unknown)
      22:47:07     @     0x7fb0c4ec7d76 mesos::v1::scheduler::Mesos::send()
      22:47:07     @     0x55771344d8e6 mesos::internal::tests::v1::scheduler::SendAcknowledgeActionP2<>::gmock_Impl<>::gmock_PerformImpl<>()
      22:47:07     @     0x55771344da5a mesos::internal::tests::v1::scheduler::SendAcknowledgeActionP2<>::gmock_Impl<>::Perform()
      22:47:07     @     0x5577133ea82e testing::Action<>::Perform()
      22:47:07     @     0x55771321ccba testing::internal::FunctionMockerBase<>::UntypedPerformAction()
      22:47:07     @     0x557714ae6a7c testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith()
      22:47:07     @     0x5577132538ca mesos::internal::tests::scheduler::MockHTTPScheduler<>::events()
      22:47:07     @     0x557713237293 std::_Function_handler<>::_M_invoke()
      22:47:07     @     0x7fb0c4ecccd8 process::AsyncExecutorProcess::execute<>()
      22:47:07     @     0x7fb0c4ed8ddd _ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEE10CallableFnINS_8internal7PartialIZNS1_8dispatchI7NothingNS1_20AsyncExecutorProcessERKSt8functionIFvRKSt5queueIN5mesos2v19scheduler5EventESt5dequeISH_SaISH_EEEEESL_SR_RSL_EENS1_6FutureIT_EERKNS1_3PIDIT0_EEMSX_FSU_T1_T2_EOT3_OT4_EUlSt10unique_ptrINS1_7PromiseISA_EESt14default_deleteIS1B_EEOSP_OSL_S3_E_JS1E_SP_SL_St12_PlaceholderILi1EEEEEEclEOS3_
      22:47:07     @     0x7fb0c6074101 process::ProcessBase::consume()
      22:47:07     @     0x7fb0c60888d7 process::ProcessManager::resume()
      22:47:07     @     0x7fb0c608dd46 _ZNSt6thread11_State_implISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv
      22:47:07     @     0x7fb0c6343edf execute_native_thread_routine
      22:47:07     @     0x7fb0c2686aa1 start_thread
      22:47:07     @     0x7fb0c1646c4d clone
      22:47:07 The test binary has crashed OR the timeout has been exceeded!
      
      // MesosContainerizer/DefaultExecutorTest.ROOT_ContainerStatusForTask/0
      
      18:51:52 PC: @     0x7fd51d72d013 mesos::v1::scheduler::Mesos::send()
      18:51:52 *** SIGSEGV (@0x0) received by PID 23718 (TID 0x7fd50f38b700) from PID 0; stack trace: ***
      18:51:52     @     0x7fd4e614aabc (unknown)
      18:51:52     @     0x7fd4e614f751 (unknown)
      18:51:52     @     0x7fd4e6142f58 (unknown)
      18:51:52     @     0x7fd51a3ae890 (unknown)
      18:51:52     @     0x7fd51d72d013 mesos::v1::scheduler::Mesos::send()
      18:51:52     @     0x558cee3c1808 _ZNK5mesos8internal5tests2v19scheduler23SendAcknowledgeActionP2INS_2v111FrameworkIDENS5_7AgentIDEE10gmock_ImplIFvPNS5_9scheduler5MesosERKNSA_12Event_UpdateEEE17gmock_PerformImplISC_SF_N7testing8internal12ExcessiveArgESL_SL_SL_SL_SL_SL_SL_EEvRKSt5tupleIJSC_SF_EET_T0_T1_T2_T3_T4_T5_T6_T7_T8_
      18:51:52     @     0x558cee3c1990 _ZN5mesos8internal5tests2v19scheduler23SendAcknowledgeActionP2INS_2v111FrameworkIDENS5_7AgentIDEE10gmock_ImplIFvPNS5_9scheduler5MesosERKNSA_12Event_UpdateEEE7PerformERKSt5tupleIJSC_SF_EE
      18:51:52     @     0x558cee2c430f _ZN7testing8internal12DoBothActionI17PromiseArgActionPILi1EPN7process7PromiseIN5mesos2v19scheduler12Event_UpdateEEEENS5_8internal5tests2v19scheduler23SendAcknowledgeActionP2INS6_11FrameworkIDENS6_7AgentIDEEEE4ImplIFvPNS7_5MesosERKS8_EE7PerformERKSt5tupleIJSN_SP_EE
      18:51:52     @     0x558cee2e9f57 testing::internal::FunctionMockerBase<>::UntypedPerformAction()
      18:51:52     @     0x558cef7b184f testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith()
      18:51:52     @     0x558cee3d075d mesos::internal::tests::scheduler::MockHTTPScheduler<>::events()
      18:51:52     @     0x558cee34cda0 std::_Function_handler<>::_M_invoke()
      18:51:52     @     0x7fd51d731098 process::AsyncExecutorProcess::execute<>()
      18:51:52     @     0x7fd51d74061b _ZN5cpp176invokeIZN7process8dispatchI7NothingNS1_20AsyncExecutorProcessERKSt8functionIFvRKSt5queueIN5mesos2v19scheduler5EventESt5dequeISA_SaISA_EEEEESE_SK_RSE_EENS1_6FutureIT_EERKNS1_3PIDIT0_EEMSQ_FSN_T1_T2_EOT3_OT4_EUlSt10unique_ptrINS1_7PromiseIS3_EESt14default_deleteIS14_EEOSI_OSE_PNS1_11ProcessBaseEE_IS17_SI_SE_S1B_EEEDTclcl7forwardISN_Efp_Espcl7forwardIT0_Efp0_EEEOSN_DpOS1D_
      18:51:52     @     0x7fd51e5205d1 process::ProcessBase::consume()
      18:51:52     @     0x7fd51e537543 process::ProcessManager::resume()
      18:51:52     @     0x7fd51e53d116 _ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv
      18:51:52     @     0x7fd51ab89970 (unknown)
      18:51:52     @     0x7fd51a3a7064 start_thread
      18:51:52     @     0x7fd51a0dc62d (unknown)
      

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            qianzhang Qian Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment