Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2188

RPC should send a ping rather than use client timeouts

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.16.1
    • Fix Version/s: 0.18.0
    • Component/s: ipc
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Replaced timeouts with pings to check that client connection is alive. Removed the property ipc.client.timeout from the default Hadoop configuration. Removed the metric RpcOpsDiscardedOPsNum.
      Show
      Replaced timeouts with pings to check that client connection is alive. Removed the property ipc.client.timeout from the default Hadoop configuration. Removed the metric RpcOpsDiscardedOPsNum.

      Description

      Current RPC (really IPC) relies on client side timeouts to find "dead" sockets. I propose that we have a thread that once a minute (if the connection has been idle) writes a "ping" message to the socket. The client can detect a dead socket by the resulting error on the write, so no client side timeout is required. Also note that the ipc server does not need to respond to the ping, just discard it.

        Attachments

        1. ipc-timeout9.patch
          54 kB
          Hairong Kuang
        2. ipc-timeout8.patch
          54 kB
          Hairong Kuang
        3. ipc-timeout7.patch
          53 kB
          Hairong Kuang
        4. ipc-timeout6.patch
          51 kB
          Hairong Kuang
        5. ipc-timeout5.patch
          50 kB
          Hairong Kuang
        6. ipc-timeout4.patch
          49 kB
          Hairong Kuang
        7. ipc-timeout3.patch
          48 kB
          Hairong Kuang
        8. ipc-timeout2.patch
          47 kB
          Hairong Kuang
        9. ipc-timeout1.patch
          48 kB
          Hairong Kuang
        10. ipc-timeout.patch
          34 kB
          Hairong Kuang
        11. rpc-to.patch
          27 kB
          Owen O'Malley

          Issue Links

            Activity

              People

              • Assignee:
                hairong Hairong Kuang
                Reporter:
                owen.omalley Owen O'Malley
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: