Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4809

Implement a SiteToSiteMetricsReportingTask

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: Extensions
    • Labels:
      None

      Description

      At the moment there is an AmbariReportingTask to send the NiFi-related metrics of the host to the Ambari Metrics Service. In a multi-cluster configuration, or when working with MiNiFi (Java) agents, it might not be possible for all the NiFi instances (NiFi and/or MiNiFi) to access the AMS REST API.

      To solve this problem, a solution would be to implement a SiteToSiteMetricsReportingTask to send the data via S2S to the "main" NiFi instance/cluster that will be able to publish the metrics into AMS (using InvokeHTTP). This way, it is possible to have the metrics of all the instances exposed in one AMS instance.

      I propose to send the data formatted as we are doing right now in the Ambari reporting task. If needed, it can be easily converted into another schema using the record processors once received via S2S.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pvillard Pierre Villard
                Reporter:
                pvillard Pierre Villard
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: