[OAK-11089] Allow SegmentReferences/RecordNumbers to provide their memory estimates - ASF JIRA

Attach files

Attach Screenshot

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Minor
Resolution: Unresolved
Affects Version/s: 1.68.0
Fix Version/s: None
Component/s: segment-tar
Labels:
None

Description

The Segment#estimateMemoryUsage currently takes into account the number of record numbers and referenced segment IDs in the segment in order to provide the total size estimate.

This can be in issue when using implementations of RecordNumbers/SegmentReferences for which determining this total count is expensive. To improve this, we should allow RecordNumbers/SegmentReferences to provide themselves an estimate. By default, this estimation would be computed in the same way as we currently do, which makes this change backwards-compatible.