[FLINK-28482] num-sorted-run.stop-trigger introduced a unstable merging

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: table-store-0.2.0, table-store-0.3.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Nicholas Jiang
• Reporter: Jingsong Lee
• Created: 11/Jul/22 06:29
• Updated: 20/Jul/22 10:22
• Resolved: 20/Jul/22 10:19

Description

We have introduced the num-sorted-run.stop-trigger. The default value is 10.
This means that the maximum number of runs generated is 10, and 10 runs may be merged at the same time during compaction or read.
Reading 10 ORC files at the same time may lead to OOM.

Issue Links

• links to: GitHub Pull Request #216