[FLINK-30206] Allow FileStoreScan to read incremental changes from OVERWRITE snapshot in Table Store

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.3.0
• Fix Version/s: table-store-0.3.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 25/Nov/22 08:36
• Updated: 30/Nov/22 07:06
• Resolved: 30/Nov/22 07:06

Description

Currently AbstractFileStoreScan can only read incremental changes from APPEND snapshots. However in OVERWRITE snapshots, users will also append new records to table. These changes must be discovered by compact job source so that the overwritten partition can be compacted.

Issue Links

• links to: GitHub Pull Request #406