Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 0.18.0
    • Component/s: ipc
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
      Show
      Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.

      Description

      IPC server determines if a connection is idle or not by checking if the connection does not have any IO activity for a predefined max idle time. An idle connection will be closed even if the connection still has outstanding requests or replies. This causes RPC failures when a server becomes slow or if a request takes a long time to be served. In jira, I'd like to propose the following changes to IPC idle management:
      1. Add data structures to the IPC server that keep track of outstanding requests.
      2. IPC server does not close a connection that has outstanding requests/replies even when it has no IO activities for a while.
      3. The default client-side max idle time should be in several minutes not 1 second.
      4. The server-side max idle time should be greater than the client-side max idle time, for example, twice of the client-side max idle time. So server mainly deals with clients that are crashed without closing
      its connections.

      1. idleConn.patch
        3 kB
        Hairong Kuang

        Issue Links

          Activity

          Hairong Kuang created issue -
          Hairong Kuang made changes -
          Field Original Value New Value
          Link This issue is part of HADOOP-2864 [ HADOOP-2864 ]
          Robert Chansler made changes -
          Fix Version/s 0.17.0 [ 12312913 ]
          Hairong Kuang made changes -
          Attachment idleConn.patch [ 12383264 ]
          Hairong Kuang made changes -
          Assignee Hairong Kuang [ hairong ]
          Fix Version/s 0.18.0 [ 12312972 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hadoop Flags [Incompatible change, Reviewed]
          Release Note Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.
          Robert Chansler made changes -
          Release Note Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.
          Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Eli Collins made changes -
          Link This issue is related to HADOOP-7949 [ HADOOP-7949 ]

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development