Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-9742

If a HTTP endpoint goes away before finishing sending of data HTTP requests hang

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: libprocess
    • Labels:
      None

      Description

      If a HTTP request is made to a remote that goes away before it finishes sending its data the HTTP request hangs forever.

      TEST_P(HTTPTest, NOPE)
      {
        Try<inet::Socket > create = inet::Socket::create();
        ASSERT_SOME(create);
      
        Future<http::Response> response;
      
        {
          // Post a request which never gets a response.
          Http http;
          EXPECT_CALL(*http.process, body(_));
          response = http::post(http.process->self(), "body/");
      
          // Wait for some time so the request was posted. There's probably
          // some internal state we could wait for.
          ASSERT_SOME(os::sleep(Milliseconds(300)));
        }
      
        AWAIT_FAILED(response); // Hangs.
      }
      

      While this has likely been an issue for some time it came up with the introduction of agent components which communicate with the agent over HTTP connections, e.g., the for the container daemon or storage local resource providers. Here it becomes hard to reason about the life cycle of async call chains, and also introduces some issues when e.g., executing tests in repetition where we effectively leak sockets (by having Future holding on to the sockets but never reaching a terminal state), see MESOS-8428.

      We should evaluate whether we can turn a closed socket into e.g., a failed Future.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bbannier Benjamin Bannier

              Dates

              • Created:
                Updated:

                Issue deployment