Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23714

Add metrics for cached KafkaConsumer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 2.3.0
    • None
    • Structured Streaming
    • None

    Description

      SPARK-23623 added KafkaDataConsumer to avoid concurrent use of cached KafkaConsumer.

      This JIRA is to add metrics for measuring the operations of the cache so that users can gain insight into the caching solution.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: