Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2562

Metrics for Flafka components

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • None
    • None

    Description

      Kafka source, sink and channel should have metrics. This will help us track down possible issues or performance problems.

      Here are the metrics I came up with:

      kafka.next.time - Time spent waiting for events from Kafka (source and channel)
      kafka.send.time - Time spent sending events (channel and sink)
      kafka.commit.time - Time spent committing (source and channel)
      events.sent - Number of events sent to Kafka (sink and channel)
      events.read - Number of events read from Kafka (channel and source)
      events.rollback - Number of event rolled back (channel) or number of rollback calls (sink)
      kafka.empty - Number of times backing off due to empty kafka topic (source)

      Attachments

        1. FLUME-2562.2.patch
          26 kB
          Gwen Shapira
        2. FLUME-2562.1.patch
          26 kB
          Gwen Shapira

        Activity

          People

            gwenshap Gwen Shapira
            gwenshap Gwen Shapira
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: