Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14031 Reduce fair call queue performance impact
  3. HADOOP-14034

Allow ipc layer exceptions to selectively close connections

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
    • Component/s: ipc
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      IPC layer exceptions generated in the readers are translated into fatal errors - resulting in connection closure. Ex. RetriableExceptions from call queue pushback.

      Always closing the connection degrades performance for all clients since a disconnected client will immediately reconnect on retry. Readers become overwhelmed servicing new connections and re-authentications from bad clients instead of servicing calls from good clients. The call queues run dry.

      Exceptions originating in the readers should be able to indicate if the exception is an error or fatal so connections can remain open.

        Attachments

        1. HADOOP-14034-trunk.patch
          32 kB
          Daryn Sharp
        2. HADOOP-14034-branch-2.patch
          31 kB
          Daryn Sharp

          Issue Links

            Activity

              People

              • Assignee:
                daryn Daryn Sharp
                Reporter:
                daryn Daryn Sharp
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: