[ARROW-2953] [Plasma] Store memory usage

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: C++ - Plasma
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19318
• Assignee: Philipp Moritz
• Reporter: Philipp Moritz
• Created: 01/Aug/18 00:14
• Updated: 11/Jan/23 07:24
• Resolved: 02/Aug/18 03:45

Description

While doing some memory profiling on the store, it became clear that at the moment the metadata of the objects takes up much more space than it should. In particular, for each object:

• The object id (20 bytes) is stored three times
• The object checksum (8 bytes) is stored twice

We can therefore significantly reduce the metadata overhead with some refactoring.

Issue Links

• links to: GitHub Pull Request #2359