[KAFKA-7877] Connect DLQ not used in SinkTask put()

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.0.1, 2.1.0
• Component/s: connect
• Assignee: Arjun Satish
• Reporter: Andrew Bourgeois
• Created: 28/Jan/19 13:35
• Updated: 28/Apr/19 18:23
• Resolved: 28/Apr/19 18:22

Description

The Dead Letter Queue isn't implemented for the put() operation.

In https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSinkTask.java the "retryWithToleranceOperator" gets used during the conversion and transformation phases, but not when delivering the messages to the sink task.

According to KIP-298, the Dead Letter Queue should be used as long as we throw org.apache.kafka.connect.errors.RetriableException.