[AMBARI-25962] Host apps metadata is not synced to other collectors when multiple collectors are installed

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: metrics-3.0.0
• Fix Version/s: 2.7.8, metrics-3.1.0
• Component/s: ambari-metrics
• Labels: pull-request-available
• Assignee: Mohammad Arshad
• Reporter: Mohammad Arshad
• Created: 28/Jun/23 07:30
• Updated: 25/Jul/23 11:58
• Resolved: 25/Jul/23 11:58

Description

Host apps metadata is not synced to other collectors when multiple metrics collectors are installed.

Steps to reproduce the issue:

1. Install ambari metrics with two collector C1 and C2
2. Submit following metrics through collector C1

   {
     "metrics": [
       {
         "metricname": "cpu",
         "appid": "skywalking",
         "hostname": "hostXYZ",
         "starttime": 1687849289558,
         "metrics": {
           "1687849289558": 100,
           "1687849295558": 200
         }
       }
     ]
   }
   

3. http://COLLECTOR_C1_HOST:6188/ws/v1/timeline/metrics/hosts API call returns 

   {
       "hostXYZ": [
           "datanode",
           "HOST",
           "namenode",
           "skywalking",
           "ams-hbase"
       ],
       ...
   }
   

   This is as expected.

4. http://COLLECTOR_C2_HOST:6188/ws/v1/timeline/metrics/hosts API call returns 

   {
       "hostXYZ": [
           "datanode",
           "HOST",
           "namenode",
           "ams-hbase"
       ],
       ...
   }
   

   This output indicates that new appid skywalking is not getting synced to other collector C2. This new appid is not getting synced even after 5 minutes which is the default ambari metrics metadata sync interval.

 

 

Issue Links

• links to: GitHub PR#3719
• links to: GitHub Pull Request #118