[FLINK-3386] Kafka consumers are not properly respecting the "auto.offset.reset" behavior

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.0
• Component/s: Connectors / Common, Connectors / Kafka
• Assignee: Robert Metzger
• Reporter: Gyula Fora
• Created: 11/Feb/16 11:27
• Updated: 19/Feb/16 18:49
• Resolved: 19/Feb/16 18:49

Description

Currently if the data in a kafka topic expires while reading from it, it causes an unrecoverable failure as subsequent retries will also fail on invalid offsets.

While this might be the desired behaviour under some circumstances, it would probably be better in most cases to automatically jump to the earliest valid offset in these cases.