[KAFKA-13839] Example connectors Maven artifact should use provided dependencies

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: connect
• Assignee: Unassigned
• Reporter: Jakub Scholz
• Created: 20/Apr/22 17:53
• Updated: 20/Apr/22 17:55

Description

The connect-file artifact which contains the sample FileStreamSourceConnector and FileStreamSourceConnector connectors has currently 2 Maven dependencies:

• connect-api
• slf4j

Both are marked as runtime dependencies. So when the connectors are pulled from Maven repository to be added to the plugin path, they pull with them also these dependencies and other transitive dependencies (such as kafka-clients). This seems unnecessary since all these dependencies are already in the classpath of Kafka itself and do not need to be there again in the plugin path. They should be configured as provided so that they are not downloaded with the connectors.

This is now more relevant after https://issues.apache.org/jira/browse/KAFKA-13748, when the connectors are not anymore on the main classpath and downloading them from Maven to the plugin path would be more common.