Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9420

Add percentile or max metric for rpcQueueTime, processing time

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.3-alpha
    • 2.3.0
    • ipc, metrics
    • None

    Description

      Currently, we only export averages for rpcQueueTime and rpcProcessingTime. These metrics are most useful when looking at timeouts and slow responses, which in my experience are often caused by momentary spikes in load, which won't show up in averages over the 15+ second time intervals often used by metrics systems. We should collect at least the max queuetime and processing time over each interval, or the percentiles if it's not too expensive.

      Attachments

        1. HADOOP-9420.txt
          3 kB
          Liang Xie
        2. HADOOP-9420-v2.txt
          8 kB
          Liang Xie

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-10305 Add "rpc.metrics.quantile.enable" and "rpc.metrics.percentiles.intervals" to core-default.xml

          • Major - Major loss of function.
          • Closed

          Activity

            People

              xieliang007 Liang Xie
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: