[FLINK-30207] Move split initialization and discovery logic fully into SnapshotEnumerator in Table Store

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.3.0
• Fix Version/s: table-store-0.3.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 25/Nov/22 08:41
• Updated: 05/Dec/22 02:24
• Resolved: 05/Dec/22 02:24

Description

It is possible that the separated compact job is started long after the write jobs. so compact job sources need a special split initialization logic: we will find the latest COMPACT snapshot, and start compacting right after this snapshot.

However, split initialization logic are currently coded into FileStoreSource. We should extract these logic into SnapshotEnumerator so that we can create our special SnapshotEnumerator for compact sources.

Issue Links

• links to: GitHub Pull Request #411