[STORM-1017] If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: storm-kafka
• Assignee: Parag Shah
• Reporter: Renkai Ge
• Created: 28/Aug/15 15:24
• Updated: 21/Oct/15 23:22
• Resolved: 21/Oct/15 23:11

Description

when ignoreZkOffsets set true and startOffsetTime = kafka.api.OffsetRequest.EarliestTime().
workers running -> topology shutdown by user and restart -> workers will read from earliest time again
workers running -> one of workers shutdown by accident and supervisor restart the worker -> what offset will the restarted worker read from?

More details on https://github.com/apache/storm/pull/493#issuecomment-135783234
It will cause a lot of unwanted duplicated messages in some scenes.

Issue Links

• is cloned by: STORM-1061 Create integration tests around ignoreZkOffsets config for kafka spout - core and trident