Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None

      Description

      Kafka source, sink and channel should have metrics. This will help us track down possible issues or performance problems.

      Here are the metrics I came up with:

      kafka.next.time - Time spent waiting for events from Kafka (source and channel)
      kafka.send.time - Time spent sending events (channel and sink)
      kafka.commit.time - Time spent committing (source and channel)
      events.sent - Number of events sent to Kafka (sink and channel)
      events.read - Number of events read from Kafka (channel and source)
      events.rollback - Number of event rolled back (channel) or number of rollback calls (sink)
      kafka.empty - Number of times backing off due to empty kafka topic (source)

        Attachments

        1. FLUME-2562.1.patch
          26 kB
          Gwen Shapira
        2. FLUME-2562.2.patch
          26 kB
          Gwen Shapira

          Activity

            People

            • Assignee:
              gwenshap Gwen Shapira
              Reporter:
              gwenshap Gwen Shapira
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: