Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2004

Need to capture metrics on the Flume exec source such as events received, rejected, etc.

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.3.0
    • 1.4.0
    • Channel, Sinks+Sources
    • None

    Description

      To give you a background, we have configured our flume agents with "exec" source to tail some logs and stream it to a set of collectors. We have monitoring setup that polls "/metrics" on these agents and verifies a few metrics like channel size, event put count etc. The "/metrics" response returns data about the 'channel' and 'sink' (we have an avro sink) components, however there is no data returned about the "source" (exec) component. We are interested in monitoring the number of events received, rejected, etc.

      I couldn't find any documentation around this; I checked the flume source and saw the metrics are not getting captured in the code as well for 'exec' source.

      Please improve the metrics captured for the 'exec' source for flume.

      Attachments

        1. FLUME-2004.patch
          4 kB
          Mike Percy
        2. FLUME-2004.patch
          8 kB
          Venkatesh

        Activity

          People

            venkyz Venkatesh
            rjustice Robert Justice
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: