[FLINK-8419] Kafka consumer's offset metrics are not registered for dynamically discovered partitions

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0, 1.5.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: Connectors / Kafka, Runtime / Metrics
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: Tzu-Li (Gordon) Tai
• Created: 12/Jan/18 01:45
• Updated: 07/Feb/18 10:36
• Resolved: 06/Feb/18 19:08

Description

Currently, the per-partition offset metrics are registered via the AbstractFetcher#addOffsetStateGauge method. That method is only ever called for the initial startup partitions, and not for dynamically discovered partitions.

We should consider adding some unit tests to make sure that metrics are properly registered for all partitions. That would also safeguard us from accidentally removing metrics.

Issue Links

• links to: GitHub Pull Request #5335
• links to: GitHub Pull Request #5336