Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15447

SwiftRestClient does not propertly close connections

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.9.0, 2.6.5, 2.7.4, 3.0.2
    • Fix Version/s: None
    • Component/s: fs/swift
    • Labels:
      None

      Description

      On production the output of netstat -a showed a large number of connections to swift hosts in the  CLOSE_WAIT and ESTABLISHED state

      The reason is that while the SwiftRestClient calls releaseConnection, because HTTP 1.1 is used, the connection is not closed by the http client. Because it could  pipeline further requests to the same host:port in the same connection.

      One way to remedy this is to add a "Connection: close" header

      This article further explains the issue : https://doc.nuxeo.com/blog/using-httpclient-properly-avoid-closewait-tcp-connections/

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jelmer1 Jelmer Kuperus
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: