[KAFKA-5012] Refactor plugin discovery in Connect to offer a global index for plugins and transformations

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.10.2.0
• Component/s: connect
• Assignee: Konstantine Karantasis
• Reporter: Konstantine Karantasis
• Created: 04/Apr/17 16:39
• Updated: 04/Apr/17 16:42

Description

Currently PluginDiscovery returns a list of plugins and a list of transformations. Consequently, the code to match and discover plugins (connectors) is a bit scattered.

This refactoring should target to index the plugins based on simple name, alias, or fully qualified name. This index should also be able to resolve conflicts between plugins with the same simple name or alias as well as tighten the checks with respect to URL validation (e.g. check that the requested plugin exists).

Possibly a Map of plugins (and maybe for symmetry a Map of transformations) will be returned by the methods in PluginDiscovery instead of a List.

This is a generalized fix related to the incremental fix implemented in: https://issues.apache.org/jira/browse/KAFKA-4837

Issue Links

• relates to: KAFKA-4837 Config validation in Connector plugins need to compare against both canonical and simple class names