[IOTDB-5793] Configuring the initial size of PublicBaos in PageWriter

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: master branch
• Component/s: Core/Engine
• Labels: PageWriter memory
• Assignee: Unassigned
• Reporter: Tian Jiang
• Created: 19/Apr/23 03:15
• Updated: 19/Apr/23 03:22

Description

A PageWriter uses two PublicBaos to buffer the encoding results of timestamps and values. However, the initial size of PublicBaos is the default (64B). Consequently, if the page is large, the PublicBaos will extend several times and each involves a full memory copy, which can be time-consuming.

To avoid unnecessary memory copy, the initial size of PublicBaos should be configurable. There are many ways to configure the value, and here are two alternatives:
1. Use half of the maximum page size as the initial size.
2. Record the (average) page size of the last flush in a context, and pass it down to PageWriter in the next flush.