[FLINK-27528] Introduce a new configuration option 'compaction.rescale-bucket' for FileStore

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.2.0
• Fix Version/s: table-store-0.2.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Jane Chan
• Reporter: Jane Chan
• Created: 06/May/22 07:46
• Updated: 07/May/22 07:55
• Resolved: 06/May/22 13:33

Description

This config key controls the behavior for ALTER TABLE ... COMPACT.

When compact.rescale-bucket is false, it indicates the compaction will rewrite data according to the bucket number, which is read from manifest meta. The commit will only add/delete files; o.w. it suggests the compaction will read bucket number from catalog meta, and the commit will overwrite the whole partition directory.

Issue Links

• links to: GitHub Pull Request #109