[FLUME-2004] Need to capture metrics on the Flume exec source such as events received, rejected, etc.

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.4.0
• Component/s: Channel, Sinks+Sources
• Assignee: Venkatesh
• Reporter: Robert Justice
• Created: 15/Apr/13 21:50
• Updated: 18/Apr/13 21:27
• Resolved: 18/Apr/13 07:50

Description

To give you a background, we have configured our flume agents with "exec" source to tail some logs and stream it to a set of collectors. We have monitoring setup that polls "/metrics" on these agents and verifies a few metrics like channel size, event put count etc. The "/metrics" response returns data about the 'channel' and 'sink' (we have an avro sink) components, however there is no data returned about the "source" (exec) component. We are interested in monitoring the number of events received, rejected, etc.

I couldn't find any documentation around this; I checked the flume source and saw the metrics are not getting captured in the code as well for 'exec' source.

Please improve the metrics captured for the 'exec' source for flume.