[FLINK-19099] consume kafka message repeat

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.11.0
• Component/s: API / DataStream, Connectors / Kafka
• Assignee: Unassigned
• Reporter: zouwenlong
• Created: 31/Aug/20 08:00
• Updated: 01/Sep/20 12:32
• Resolved: 01/Sep/20 12:32

Description

when taksmanager be killed ,my job consume some message , but the offset in not commit,

then restart it ,my job consume kafka message repeat,  I used checkpoint  and set 5 seconds ,

I think this is a very common problem，how to solve this problem？