[OAK-6106] Excessive memory usage by the cached segment references

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Bug
• Component/s: segment-tar
• Labels: perfomance
• Epic Link: TarMK content scalability
• Assignee: Michael Dürig
• Reporter: Michael Dürig
• Created: 20/Apr/17 08:59
• Updated: 25/Apr/17 10:22
• Resolved: 25/Apr/17 10:08

Description

The references of a segment to other segments are cached within Segment.readReferencedSegments(). However caching the SegmentId instances themselves leads to excessive heap usage as each id also keeps a reference to its underlying segment.

I suggest to cache those references as msb, lsb pairs instead and create the SegmentId instance on the fly when required.

Issue Links

• relates to: OAK-4949 SegmentWriter buffers child node list changes