[FLINK-30573] Table Store dedicated compact job may skip some records when checkpoint interval is long

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.3.0, table-store-0.4.0
• Fix Version/s: table-store-0.3.0, table-store-0.4.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 05/Jan/23 09:53
• Updated: 06/Jan/23 08:27
• Resolved: 06/Jan/23 08:27

Description

Currently the sink for Table Store dedicated compact job only receives records about what buckets are changed, instead of what files are changed. If the writer is kept open, new files of this bucket may be skipped.

Issue Links

• links to: GitHub Pull Request #460