[FLINK-29273] Page not enough Exception in SortBufferMemTable

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: table-store-0.3.0, table-store-0.2.1
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 13/Sep/22 03:03
• Updated: 13/Sep/22 09:44
• Resolved: 13/Sep/22 09:44

Description

When there are many partitions, the partition writer will seize memory and may have the following exceptions:

We need to make sure that the writer has enough memory before it can start.

Actually, there is enough memory, because it can preempt from other writers. The problem is in OwnerMemoryPool.freePages, it should contain preemptable memory.

Issue Links

• relates to: FLINK-29276 Flush all memory in SortBufferMemTable.clear
• links to: GitHub Pull Request #291