[FLINK-24409] Kafka topics with periods in their names generate a constant stream of errors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0, 1.15.0
• Fix Version/s: 1.14.3, 1.15.0
• Component/s: Connectors / Kafka
• Labels: pull-request-available
• Assignee: Fabian Paul
• Reporter: Brad Davis
• Created: 30/Sep/21 07:41
• Updated: 15/Dec/21 01:44
• Resolved: 17/Nov/21 16:57

Description

Attempting to port a job that worked on 1.13.2 over to 1.14.0 I encountered this error.  Going into the code I discovered that the reason seems to be this logic.  But the tags being examined here are generated at least partly by this code.  The tags always translate periods in the topic name to underscores, but the code in KafkaSourceReaderMetrics uses the untransformed topic name in the filter.  Therefore if the topic name has a period in it the filtering logic will always fail.

 The code that's generating the error is apparently very recent, being merged in this PR https://github.com/apache/flink/pull/16838

 

 

Issue Links

• causes: FLINK-24497 Kafka metrics fetching throws IllegalStateException
• links to: GitHub Pull Request #17401
• links to: GitHub Pull Request #17773
• links to: GitHub Pull Request #17799