Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-3773

RegistryClientTest.SimpleGetBlob is flaky

    Details

    • Sprint:
      Mesosphere Sprint 21, Mesosphere Sprint 24
    • Story Points:
      4

      Description

      RegistryClientTest.SimpleGetBlob fails about 1/5 times. This was encountered on OSX.

      Repro
      bin/mesos-tests.sh --gtest_filter="*RegistryClientTest.SimpleGetBlob*" --gtest_repeat=10 --gtest_break_on_failure
      
      Example Failure
      [ RUN      ] RegistryClientTest.SimpleGetBlob
      ../../src/tests/containerizer/provisioner_docker_tests.cpp:946: Failure
      Value of: blobResponse
        Actual: "2015-10-20 20:58:59.579393024+00:00"
      Expected: blob.get()
      Which is: "\x15\x3\x3\00(P~\xCA&\xC6<\x4\x16\xE\xB2\xFF\b1a\xB9Z{\xE0\x80\xDA`\xBCt\x5R\x81x6\xF8 \x8B{\xA8\xA9\x4\xAB\xB6" "E\xE6\xDE\xCF\xD9*\xCC!\xC2\x15" "2015-10-20 20:58:59.579393024+00:00"
      *** Aborted at 1445374739 (unix time) try "date -d @1445374739" if you are using GNU date ***
      PC: @        0x103144ddc testing::UnitTest::AddTestPartResult()
      *** SIGSEGV (@0x0) received by PID 49008 (TID 0x7fff73ca3300) stack trace: ***
          @     0x7fff8c58af1a _sigtramp
          @     0x7fff8386e187 malloc
          @        0x1031445b7 testing::internal::AssertHelper::operator=()
          @        0x1030d32e0 mesos::internal::tests::RegistryClientTest_SimpleGetBlob_Test::TestBody()
          @        0x1030d3562 mesos::internal::tests::RegistryClientTest_SimpleGetBlob_Test::TestBody()
          @        0x1031ac8f3 testing::internal::HandleSehExceptionsInMethodIfSupported<>()
          @        0x103192f87 testing::internal::HandleExceptionsInMethodIfSupported<>()
          @        0x1031533f5 testing::Test::Run()
          @        0x10315493b testing::TestInfo::Run()
          @        0x1031555f7 testing::TestCase::Run()
          @        0x103163df3 testing::internal::UnitTestImpl::RunAllTests()
          @        0x1031af8c3 testing::internal::HandleSehExceptionsInMethodIfSupported<>()
          @        0x103195397 testing::internal::HandleExceptionsInMethodIfSupported<>()
          @        0x1031639f2 testing::UnitTest::Run()
          @        0x1025abd41 RUN_ALL_TESTS()
          @        0x1025a8089 main
          @     0x7fff86b155c9 start
      
      Less common failure
      [ RUN      ] RegistryClientTest.SimpleGetBlob
      ../../src/tests/containerizer/provisioner_docker_tests.cpp:926: Failure
      (socket).failure(): Failed accept: connection error: error:00000000:lib(0):func(0):reason(0)
      

        Issue Links

          Activity

          Show
          anandmazumdar Anand Mazumdar added a comment - Dup of https://issues.apache.org/jira/browse/MESOS-3726 ?
          Hide
          gilbert Gilbert Song added a comment -

          Seems to be separate failures. We can keep both and link together.

          Show
          gilbert Gilbert Song added a comment - Seems to be separate failures. We can keep both and link together.
          Show
          jojy Jojy Varghese added a comment - https://reviews.apache.org/r/39518
          Hide
          anandmazumdar Anand Mazumdar added a comment -

          Re-opening:
          https://builds.apache.org/job/Mesos/1296/COMPILER=gcc,CONFIGURATION=--verbose%20--enable-libevent%20--enable-ssl,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console

          [ RUN      ] RegistryClientTest.SimpleGetBlob
          2015-12-01 02:33:02,566:31760(0x2b94b0200700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:41913] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
          I1201 02:33:02.603672 31781 registry_client.cpp:511] Response status for url 'https://localhost:41372/v2/library/blob/blobs/digest': 401 Unauthorized
          I1201 02:33:02.621564 31786 registry_client.cpp:511] Response status for url 'https://localhost:41372/v2/library/blob/blobs/digest': 307 Temporary Redirect
          I1201 02:33:02.628077 31791 registry_client.cpp:511] Response status for url 'https://127.0.0.1:41372/': 200 OK
          ../../src/tests/containerizer/provisioner_docker_tests.cpp:939: Failure
          Value of: blobResponse
            Actual: "2015-12-29 03:49:20.648481088+00:00"
          Expected: blob.get()
          Which is: "\x15\x3\x3\00A\x9E\xEE\vrz\xDA\xC6$z\xE6\xEC\b\f8\xCB\x93\xD9\xA3\xEFv\x9E\xEA\x99\xEB\x1F\x9C:Ic#8C\x1\xC4\xF3\xC3\xCB\xB1\x17\xBE\x87\x1B/\xE7y->2015-12-29 03:49:20.648481088+00:00"
          [  FAILED  ] RegistryClientTest.SimpleGetBlob (385 ms)
          
          Show
          anandmazumdar Anand Mazumdar added a comment - Re-opening: https://builds.apache.org/job/Mesos/1296/COMPILER=gcc,CONFIGURATION=--verbose%20--enable-libevent%20--enable-ssl,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console [ RUN ] RegistryClientTest.SimpleGetBlob 2015-12-01 02:33:02,566:31760(0x2b94b0200700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:41913] zk retcode=-4, errno=111(Connection refused): server refused to accept the client I1201 02:33:02.603672 31781 registry_client.cpp:511] Response status for url 'https: //localhost:41372/v2/library/blob/blobs/digest': 401 Unauthorized I1201 02:33:02.621564 31786 registry_client.cpp:511] Response status for url 'https: //localhost:41372/v2/library/blob/blobs/digest': 307 Temporary Redirect I1201 02:33:02.628077 31791 registry_client.cpp:511] Response status for url 'https: //127.0.0.1:41372/': 200 OK ../../src/tests/containerizer/provisioner_docker_tests.cpp:939: Failure Value of: blobResponse Actual: "2015-12-29 03:49:20.648481088+00:00" Expected: blob.get() Which is: "\x15\x3\x3\00A\x9E\xEE\vrz\xDA\xC6$z\xE6\xEC\b\f8\xCB\x93\xD9\xA3\xEFv\x9E\xEA\x99\xEB\x1F\x9C:Ic#8C\x1\xC4\xF3\xC3\xCB\xB1\x17\xBE\x87\x1B/\xE7y->2015-12-29 03:49:20.648481088+00:00" [ FAILED ] RegistryClientTest.SimpleGetBlob (385 ms)
          Show
          jojy Jojy Varghese added a comment - https://reviews.apache.org/r/41253/
          Hide
          jojy Jojy Varghese added a comment - - edited
          Show
          jojy Jojy Varghese added a comment - - edited same root cause for https://issues.apache.org/jira/browse/MESOS-3726

            People

            • Assignee:
              jojy Jojy Varghese
              Reporter:
              kaysoky Joseph Wu
              Shepherd:
              Joris Van Remoortere
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development

                  Agile