Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-15026

Hadoop metrics emit interval seems to be 1 minute instead of 10 seconds default

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.2.0
    • 2.2.2
    • ambari-metrics
    • None

    Description

      Noticed this after upgrade from 2.1.2 to 2.2.0.

      Bug seems to have been introduced bu AMBARI-13037.

      Need to ensure, send internal of 60 seconds and leaving the collection or sampling interval as default.

      0: jdbc:phoenix:localhost:61181:/ams-hbase-un> select * from METRIC_RECORD where METRIC_NAME='rpc.rpc.RpcQueueTimeAvgTime' and APP_ID = 'namenode' order by SERVER_TIME desc limit 10;
      +-------------+------------+-------------+------------+-------------+------------+----------------------+------------+--------------+------------+------------+------------+
      | METRIC_NAME |  HOSTNAME  | SERVER_TIME |   APP_ID   | INSTANCE_ID | START_TIME |        UNITS         | METRIC_SUM | METRIC_COUNT | METRIC_MAX | METRIC_MIN |  METRICS   |
      +-------------+------------+-------------+------------+-------------+------------+----------------------+------------+--------------+------------+------------+------------+
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155926917 | namenode   | null        | 1455155866867 | null                 | 0.0        | 2            | 0.0        | 0.0        | {"1455155866867":0.0,"1455155926867":0.0} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155806915 | namenode   | null        | 1455155746868 | null                 | 0.5        | 2            | 0.5        | 0.0        | {"1455155746868":0.5,"1455155806868":0.0} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155686901 | namenode   | null        | 1455155626867 | null                 | 2.0        | 2            | 1.0        | 1.0        | {"1455155626867":1.0,"1455155686867":1.0} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155566987 | namenode   | null        | 1455155446868 | null                 | 1.5        | 3            | 1.0        | 0.0        | {"1455155446868":0.0,"1455155506866":1.0,"1455155566872":0.5} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155221565 | namenode   | null        | 1455155101498 | null                 | 2.5        | 3            | 1.0        | 0.5        | {"1455155101498":1.0,"1455155161496":1.0,"1455155221497":0.5} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455155041553 | namenode   | null        | 1455154981496 | null                 | 2.5        | 2            | 2.5        | 0.0        | {"1455154981496":0.0,"1455155041498":2.5} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455154921619 | namenode   | null        | 1455154801501 | null                 | 0.8333333333333334 | 3            | 0.5        | 0.0        | {"1455154801501":0.5,"1455154861497":0.33333333333333337,"1455154921497":0.0} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455154679870 | namenode   | null        | 1455154619738 | null                 | 1.0        | 2            | 1.0        | 0.0        | {"1455154619738":1.0,"1455154679738":0.0} |
      | rpc.rpc.RpcQueueTimeAvgTime | c6401.ambari.apache.org | 1455154559985 | namenode   | null        | 1455154439747 | null                 | 1.5        | 3            | 1.0        | 0.0        | {"1455154439747":0.5,"1455154499738":0.0,"1455154559740":1.0} |
      +-------------+------------+-------------+------------+-------------+------------+----------------------+------------+--------------+------------+------------+------------+
      9 rows selected (0.485 seconds)
      

      Attachments

        1. AMBARI-15026-trunk.patch
          6 kB
          Dmytro Sen

        Issue Links

          Activity

            People

              dsen Dmytro Sen
              dsen Dmytro Sen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: