Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14492

RpcDetailedMetrics and NameNodeMetrics use different rate metrics abstraction cause the Xavgtime confused

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Invalid
    • 2.8.0, 2.7.4
    • None
    • metrics
    • None

    Description

      For performance purpose, HADOOP-13782 change the metrics behaviour in RpcDetailedMetrics.
      In 2.7.4:

      public class RpcDetailedMetrics {
      
        @Metric MutableRatesWithAggregation rates;
      

      In old version:

      public class RpcDetailedMetrics {
      
        @Metric MutableRates rates;
      

      But NameNodeMetrics still use MutableRate whatever in the new or old version:

      public class NameNodeMetrics {
        @Metric("Block report") MutableRate blockReport;
      

      It causes the metrics in JMX very different between them.

      name: "Hadoop:service=NameNode,name=RpcDetailedActivityForPort8030",
      modelerType: "RpcDetailedActivityForPort8030",
      tag.port: "8030",
      tag.Context: "rpcdetailed",
      ...
      BlockReportNumOps: 237634,
      BlockReportAvgTime: 1382,
      ...

      name: "Hadoop:service=NameNode,name=NameNodeActivity",
      modelerType: "NameNodeActivity",
      tag.ProcessName: "NameNode",
      ...
      BlockReportNumOps: 2592932,
      BlockReportAvgTime: 19.258064516129032,
      ...

      In the old version. They are correct.

      Attachments

        Issue Links

          Activity

            People

              xkrogen Erik Krogen
              cltlfcjin Lantao Jin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: