[OAK-11089] Allow SegmentReferences/RecordNumbers to provide their memory estimates

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.68.0
• Component/s: segment-tar
• Assignee: Unassigned
• Reporter: Nicolas Ettlin
• Created: 06/Sep/24 12:01
• Updated: 23/Sep/24 12:39

Description

The Segment#estimateMemoryUsage currently takes into account the number of record numbers and referenced segment IDs in the segment in order to provide the total size estimate.

This can be in issue when using implementations of RecordNumbers/SegmentReferences for which determining this total count is expensive. To improve this, we should allow RecordNumbers/SegmentReferences to provide themselves an estimate. By default, this estimation would be computed in the same way as we currently do, which makes this change backwards-compatible.

Issue Links

• links to: GitHub Pull Request #1733