[FLINK-12574] using sink StreamingFileSink files are overwritten when resuming application causing data loss

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Not A Bug
• Affects Version/s: 1.8.0
• Component/s: Connectors / FileSystem
• Assignee: Unassigned
• Reporter: yitzchak lieberman
• Created: 21/May/19 11:13
• Updated: 18/Oct/19 02:38
• Resolved: 26/May/19 07:43

Description

when part files are saved to s3 bucket (with bucket assigner) with simple names such as:

part-0-0 and part-1-2

restarting or resuming application causes checkpoint id to start from 0 and old files will be replaced by new part files.