[FLINK-7931] FlinkKinesisProducer violates at-least-once guarantees (1.3 branch)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Won't Fix
• Component/s: Connectors / Kinesis
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: Tzu-Li (Gordon) Tai
• Created: 26/Oct/17 10:36
• Updated: 06/Nov/18 11:16
• Resolved: 06/Nov/18 11:16

Description

Currently, there is no flushing of KPL outstanding records on checkpoints in the FlinkKinesisProducer. Likewise to the at-least-once issue on the Flink Kafka producer before, this may lead to data loss if there are asynchronous failing records after a checkpoint which the records was part of was completed.

Issue Links

• is a clone of: FLINK-7637 FlinkKinesisProducer violates at-least-once guarantees