[KAFKA-9985] Sink connector consuming DLQ topic may exhaust broker

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.1, 2.5.0, 2.4.1
• Fix Version/s: 2.6.0, 2.4.2, 2.5.1
• Assignee: Mario Molina
• Reporter: Mario Molina
• Reviewer: Randall Hauch
• Created: 13/May/20 02:52
• Updated: 11/Jun/20 03:11
• Resolved: 11/Jun/20 03:11

Description

When a sink connector is configured with a DLQ and its topic is the same (or matches) as the topic in which the connector reads, the broker and/or connector might be exhausted in case the record send to the topic is invalid.

Based on the broker/connect config, the connector might fail throwing a RecordTooLargeException previous to exhaust the broker/connector.

Issue Links

• links to: GitHub Pull Request #8663