[KAFKA-17192] MirrorMaker2 worker config does not pass config.providers value to connectors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.7.0, 3.7.1
• Fix Version/s: 3.9.0, 3.7.2, 3.8.1
• Component/s: mirrormaker
• Assignee: Bertalan Kondrat
• Reporter: Bertalan Kondrat
• Reviewer: Chris Egerton
• Created: 24/Jul/24 08:36
• Updated: 01/Sep/24 13:27
• Resolved: 31/Jul/24 20:53

Description

MirrorMaker2 worker config does not pass config.providers value to connectors.

With this commit we changed the behavior of the stringsWithPrefix method.
The new implementation does not include the configurations where the prefix exactly the same as the config key.

For example:

Prefix:

config.providers

Configs:

config.providers=env
config.providers.env.class=org.apache.kafka.common.config.provider.EnvVarConfigProvider

Result:

config.providers.env.class=org.apache.kafka.common.config.provider.EnvVarConfigProvider 

The result does not include the 

config.providers=env

 

As a result of this behavior, the connectors could not resolve variables.

Reproduction is easy, just start an MM2 instance with the following config

ssl.truststore.location=${env:TRUSTSTORE_LOCATION}

config.providers=env
config.providers.env.class=org.apache.kafka.common.config.provider.EnvVarConfigProvider 

Check the connector configs in the log. (grep for ${env:TRUSTSTORE_LOCATION})

Issue Links

• is caused by: KAFKA-14021 MirrorMaker 2 should implement KIP-618 APIs
• links to: GitHub Pull Request #16678