[FLUME-2495] Kafka Source may miss events when channel is not available

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Sinks+Sources
• Assignee: Gwen Shapira
• Reporter: Gwen Shapira
• Created: 06/Oct/14 21:31
• Updated: 17/Apr/15 01:21
• Resolved: 07/Oct/14 21:13

Description

Because the Kafka consumer itself tracks offsets, and we don't restart the consumer when we get channel errors, the consumer will skip messages that we couldn't write to channel, even though we did not advance offset in Zookeeper.