Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2004

Need to capture metrics on the Flume exec source such as events received, rejected, etc.

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.4.0
    • Component/s: Channel, Sinks+Sources
    • Labels:
      None

      Description

      To give you a background, we have configured our flume agents with "exec" source to tail some logs and stream it to a set of collectors. We have monitoring setup that polls "/metrics" on these agents and verifies a few metrics like channel size, event put count etc. The "/metrics" response returns data about the 'channel' and 'sink' (we have an avro sink) components, however there is no data returned about the "source" (exec) component. We are interested in monitoring the number of events received, rejected, etc.

      I couldn't find any documentation around this; I checked the flume source and saw the metrics are not getting captured in the code as well for 'exec' source.

      Please improve the metrics captured for the 'exec' source for flume.

        Attachments

        1. FLUME-2004.patch
          8 kB
          Venkatesh Sivasubramanian
        2. FLUME-2004.patch
          4 kB
          Mike Percy

          Activity

            People

            • Assignee:
              venkyz Venkatesh Sivasubramanian
              Reporter:
              rjustice Robert Justice
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: