Major Description
Currently, the worker configuration file defines the connection properties for the three separate types of connections being made to the Kafka cluster:
- the worker group membership,
- producers for source connectors,
- the consumers for sink connectors.
The configs are namespaced because to properly support things like interceptors where the configs for 2 and 3 would conflict (same config name, different value).
However, it would be beneficial when such control is not required for the producers and consumers to inherit the top-level configurations yet be able to override them with the producer. and consumer. namespaced configurations. This way the producer- and consumer-specific configurations need only be specified if/when they need to override the top-level configurations. This may be necessary, for example, to have different ACLs than the connector tasks compared to the producers and consumers.
This will require a minimal KIP to explain the new behavior.