[FLUME-3050] add counters for error conditions and expose to monitor URL

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.7.0
• Fix Version/s: 1.9.0
• Component/s: Channel, Shell, Sinks+Sources
• Labels: features
• Assignee: Endre Major
• Reporter: Yuval Lifshitz
• Created: 02/Feb/17 08:27
• Updated: 28/Aug/18 11:42
• Resolved: 28/Aug/18 11:42

Description

currently error counters are not present when getting stats. for example:

 > curl http://my-flume-host:44444/metrics
{"SINK.k1":{"ConnectionCreatedCount":"1","ConnectionClosedCount":"0","Type":"SINK","BatchCompleteCount":"0","BatchEmptyCount":"4","EventDrainAttemptCount":"10","StartTime":"1485348138992","EventDrainSuccessCount":"10","BatchUnderflowCount":"1","StopTime":"0","ConnectionFailedCount":"0"},"CHANNEL.c1":{"ChannelCapacity":"1000000","ChannelFillPercentage":"0.0","Type":"CHANNEL","ChannelSize":"0","EventTakeSuccessCount":"10","EventTakeAttemptCount":"15","StartTime":"1485348138990","EventPutAttemptCount":"10","EventPutSuccessCount":"10","StopTime":"0"},"SOURCE.r1":{"EventReceivedCount":"10","AppendBatchAcceptedCount":"0","Type":"SOURCE","AppendReceivedCount":"0","EventAcceptedCount":"10","StartTime":"1485348138993","AppendAcceptedCount":"0","OpenConnectionCount":"0","AppendBatchReceivedCount":"0","StopTime":"0"}}

return only "good" stats for source, channel and sink.
to get error you need to look into the log file. this makes it hard to integrate flume into automatic monitoring systems, NMS etc.

Issue Links

• links to: GitHub Pull Request #222