[IGNITE-4198] Ignite Kafka sink connector should have an option to transform Kafka values

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.7
• Fix Version/s: 1.8
• Component/s: streaming
• Labels: community streaming
• Assignee: Roman Shtykh
• Reporter: Roman Shtykh
• Created: 09/Nov/16 06:47
• Updated: 16/Nov/16 01:42
• Resolved: 16/Nov/16 01:40

Description

Currently the connector takes a Kafka key and uses it as an Ignite key. However, Kafka keys can be null, and users may want to specify an Ignite key from the value object.

Instead of creating a new transformer interface, I think we can use StreamMultipleTupleExtractor whenever its implementation is specified by the user in connector config file.

http://apache-ignite-users.70518.x6.nabble.com/Kafka-Failed-to-stream-a-record-with-null-key-td8731.html

Issue Links

• is duplicated by: IGNITE-4199 Functionality to extract keys from values when sinking data from kafka topics
• links to: GitHub Pull Request #1225