[KAFKA-6890] Add connector level configurability for producer/consumer client configs

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: connect
• Assignee: Unassigned
• Reporter: Allen Tang
• Created: 09/May/18 22:13
• Updated: 21/Mar/20 23:38
• Resolved: 17/Oct/19 02:27

Description

Right now, each source connector and sink connector inherit their client configurations from the worker properties. Within the worker properties, all configurations that have a prefix of "producer." or "consumer." are applied to all source connectors and sink connectors respectively.

We should also provide connector-level overrides whereby connector properties that are prefixed with "producer." and "consumer." are used to feed into the producer and consumer clients embedded within source and sink connectors respectively. The prefixes will be removed via a String#substring() call, and the remainder of the connector property key will be used as the client configuration key. The value is fed directly to the client as the configuration value.

Issue Links

• duplicates: KAFKA-8265 Connect Client Config Override policy
• is cloned by: KAFKA-8265 Connect Client Config Override policy
• links to: GitHub Pull Request #4997