Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6780

Create a Metrics Query Reporting Task

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.10.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently NiFi has metrics reporting tasks which have a specific set of metrics that are sent out to via site-to-site or other protocols. To expand upon this a query based reporting task is proposed to provide users the flexibility to select the types of metrics and the conditions on they should be reported using sql like statements.

       It may be desired that the results of a query are transmitted to any number of targets. The current pattern is to implement this as a Site-to-Site reporting task, but that puts the onus on the user to create a sub-flow with an Input Port for receiving the S2S messages, and it creates additional provenance events for these. A new approach to be considered here is to decouple the results from the destination. Proposed is a RecordSinkService controller service interface, which the query-based reporting task uses to transmit the query results. The configured RecordSinkService implementation would be responsible for the actual transmission of results to the sink. Possible initial implementations include a Site-To-Site RecordSink (for feature parity with the other reporting tasks) and a DatabaseRecordSink (to transmit the query results to an external RDBMS using DBCPConnectionPool).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mattyb149 Matt Burgess
                Reporter:
                YolandaMDavis Yolanda M. Davis
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2.5h
                  2.5h