[FLUME-2562] Metrics for Flafka components

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Assignee: Gwen Shapira
• Reporter: Gwen Shapira
• Created: 21/Nov/14 11:37
• Updated: 17/Jan/15 16:04
• Resolved: 17/Jan/15 00:26

Description

Kafka source, sink and channel should have metrics. This will help us track down possible issues or performance problems.

Here are the metrics I came up with:

kafka.next.time - Time spent waiting for events from Kafka (source and channel)
kafka.send.time - Time spent sending events (channel and sink)
kafka.commit.time - Time spent committing (source and channel)
events.sent - Number of events sent to Kafka (sink and channel)
events.read - Number of events read from Kafka (channel and source)
events.rollback - Number of event rolled back (channel) or number of rollback calls (sink)
kafka.empty - Number of times backing off due to empty kafka topic (source)