Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2562

Metrics for Flafka components

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • None
    • None

    Description

      Kafka source, sink and channel should have metrics. This will help us track down possible issues or performance problems.

      Here are the metrics I came up with:

      kafka.next.time - Time spent waiting for events from Kafka (source and channel)
      kafka.send.time - Time spent sending events (channel and sink)
      kafka.commit.time - Time spent committing (source and channel)
      events.sent - Number of events sent to Kafka (sink and channel)
      events.read - Number of events read from Kafka (channel and source)
      events.rollback - Number of event rolled back (channel) or number of rollback calls (sink)
      kafka.empty - Number of times backing off due to empty kafka topic (source)

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gwenshap Gwen Shapira
            gwenshap Gwen Shapira
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment