[FLINK-27085] Introduce snapshot.num-retained.min option

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.1.0
• Fix Version/s: table-store-0.1.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 06/Apr/22 07:16
• Updated: 06/Apr/22 10:06
• Resolved: 06/Apr/22 10:06

Description

Currently we retain at least 1 snapshot when expiring. However consider the following scenario:

A user writes a snapshot one day ago. Today he is reading this snapshot and meanwhile writing more records. If a new snapshot is created and the reading is not finished, the old snapshot created one day ago will be removed as it exceeds maximum retaining time. This will cause the reading to fail.

We should introduce snapshot.num-retained.min to at least retain a minimum number of snapshots to avoid this problem.

Issue Links

• links to: GitHub Pull Request #75