Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2004

Need to capture metrics on the Flume exec source such as events received, rejected, etc.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.4.0
    • Component/s: Channel, Sinks+Sources
    • Labels:
      None

      Description

      To give you a background, we have configured our flume agents with "exec" source to tail some logs and stream it to a set of collectors. We have monitoring setup that polls "/metrics" on these agents and verifies a few metrics like channel size, event put count etc. The "/metrics" response returns data about the 'channel' and 'sink' (we have an avro sink) components, however there is no data returned about the "source" (exec) component. We are interested in monitoring the number of events received, rejected, etc.

      I couldn't find any documentation around this; I checked the flume source and saw the metrics are not getting captured in the code as well for 'exec' source.

      Please improve the metrics captured for the 'exec' source for flume.

        Attachments

          Activity

            People

            • Assignee:
              venkyz Venkatesh
              Reporter:
              rjustice Robert Justice

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment