[FLUME-2861] KafkaChannel decomission can lead to loss of data

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.6.0
• Component/s: Channel
• Assignee: Unassigned
• Reporter: jweinste
• Created: 21/Dec/15 16:05
• Updated: 21/Dec/15 16:20

Description

Events may be taken, but not Transaction.committed when decommission is called, resulting in potential loss of data.

doTake()...
eventTaken = true;
events.get().add(e);

stop()...

private void decommissionConsumerAndIterator(ConsumerAndIterator c) {
if (c.failedEvents.isEmpty())

{ c.consumer.commitOffsets(); }