Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12903

IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: ipc
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HADOOP-10597 added support for RPC congestion control by sending retriable 'server too busy' exceptions to clients.

      However every backoff results in a log message. We've seen these log messages slow down the NameNode.

      2016-03-07 15:02:23,272 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8020: readAndProcess from client 127.0.0.1 threw exception [org.apache.hadoop.ipc.RetriableException: Server is too busy.]
      

      We already have a metric that tracks the number of backoff events. This log message adds nothing useful.

      The IPC Server should also allow services to skip logging certain exception types altogether.

        Attachments

        1. checkstyle-fixes.patch
          2 kB
          Arpit Agarwal
        2. HADOOP-12903.01.patch
          12 kB
          Arpit Agarwal
        3. HADOOP-12903.02.patch
          12 kB
          Arpit Agarwal
        4. HADOOP-12903.03.patch
          12 kB
          Arpit Agarwal

          Activity

            People

            • Assignee:
              arpitagarwal Arpit Agarwal
              Reporter:
              arpitagarwal Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: