[FLINK-30209] Introduce CompactFileStoreSource for compact jobs of Table Store

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.3.0
• Fix Version/s: table-store-0.3.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 25/Nov/22 08:49
• Updated: 12/Dec/22 12:25
• Resolved: 12/Dec/22 12:25

Description

In this ticket we create the CompactFileStoreSource Flink source for separated compact jobs.

The behavior of this source is sketched as follows:

• For batch compact jobs, this source produces records containing all partitions and buckets of the current table.
• For streaming compact jobs, this source produces records containing all modified partitions and buckets of a snapshot. This source will also monitor on newly created snapshots.

Issue Links

• links to: GitHub Pull Request #429