[IGNITE-13424] Ignite Sink Task issue in Kafka integration

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.8.1
• Component/s: streaming
• Flags: Important
• Assignee: Unassigned
• Reporter: Aditya
• Created: 10/Sep/20 07:20
• Updated: 11/Sep/20 14:45
• Resolved: 11/Sep/20 14:44

Description

We are trying to implement the replication of data between two Ignite data clusters.

For this purpose, we are using Kafka Connect.

We have followed the things mentioned in this document -> https://dzone.com/articles/linking-apache-ignite-and-apache-kafka-for-highly

Everything is working fine till we use one cache and PUT operation.

But when I use the same for REMOVED operation, in the consumer thread of the connector, I can see the CacheEvent record, but the data is not being removed from the Sink Cluster nodes.

When checked, the remove functionality is missing in IgniteSinkTask class.

Is IgniteSink connector only for injecting data? The data record type at the receiving end is of type CacheEvent. Based on the operation it should put or remove right? As of now only, PUT is working.

Issue Links

• duplicates: IGNITE-13442 Implement removals support in Ignite Kafka sink connector