[FLUME-2920] Kafka Channel Should Not Commit Offsets When Stopping

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.7.0
• Component/s: Channel
• Assignee: Kevin Conaway
• Reporter: Kevin Conaway
• Created: 09/Jun/16 12:40
• Updated: 18/Jun/16 17:16
• Resolved: 10/Jun/16 13:56

Description

The Kafka channel commits the consumer offsets when shutting down (via stop() -> decommissionConsumerAndRecords())

This can lead to data loss if the channel is shut down while messages have been fetched in a transaction but the transaction has not yet been committed.

The only time that the offsets should be committed is when a transaction is complete.

Issue Links

• links to: GitHub Pull Request #51