Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-8419

Kafka consumer's offset metrics are not registered for dynamically discovered partitions

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.4.0, 1.5.0
    • Fix Version/s: 1.5.0, 1.4.1
    • Component/s: Kafka Connector, Metrics
    • Labels:
      None

      Description

      Currently, the per-partition offset metrics are registered via the AbstractFetcher#addOffsetStateGauge method. That method is only ever called for the initial startup partitions, and not for dynamically discovered partitions.

      We should consider adding some unit tests to make sure that metrics are properly registered for all partitions. That would also safeguard us from accidentally removing metrics.

        Attachments

          Activity

            People

            • Assignee:
              tzulitai Tzu-Li (Gordon) Tai
              Reporter:
              tzulitai Tzu-Li (Gordon) Tai
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: