Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12325

RPC Metrics : Add the ability track and log slow RPCs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 2.7.4, 3.0.0-alpha1
    • ipc, metrics
    • None
    • Reviewed

    Description

      This JIRA proposes to add a counter called RpcSlowCalls and also a configuration setting that allows users to log really slow RPCs. Slow RPCs are RPCs that fall at 99th percentile. This is useful to troubleshoot why certain services like name node freezes under heavy load.

      Attachments

        1. HADOOP-12325.001.patch
          17 kB
          Anu Engineer
        2. HADOOP-12325.002.patch
          15 kB
          Anu Engineer
        3. HADOOP-12325.003.patch
          15 kB
          Anu Engineer
        4. Callers of WritableRpcEngine.call.png
          142 kB
          Xiaoyu Yao
        5. HADOOP-12325.004.patch
          15 kB
          Anu Engineer
        6. HADOOP-12325.005.patch
          16 kB
          Anu Engineer
        7. HADOOP-12325.005.test.patch
          16 kB
          Akira Ajisaka
        8. HADOOP-12325.006.patch
          16 kB
          Anu Engineer
        9. HADOOP-12325-branch-2.7.00.patch
          18 kB
          Zhe Zhang

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HADOOP-12457 [JDK8] Fix a failure of compiling common by javadoc

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15840 Slow RPC logger too spammy

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5180 Output the processing time of slow RPC request to node's log

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              aengineer Anu Engineer
              aengineer Anu Engineer
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: