[ARROW-3548] Speed up storing small objects in the object store.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: C++ - Plasma
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19862
• Assignee: Robert Nishihara
• Reporter: Robert Nishihara
• Created: 18/Oct/18 01:24
• Updated: 11/Jan/23 07:28
• Resolved: 19/Oct/18 01:15

Description

Currently, to store an object in the plasma object store, there are a lot of IPCs. We first call "Create", which does an IPC round trip. Then we call "Seal", which is one IPC. Then we call "Release", which is another IPC.

For small objects, we can just inline the object and metadata directly into the message to the store, and wait for the response (the response tells us if the object was successfully created). This is just a single IPC round trip, which can be much faster.

Issue Links

• links to: GitHub Pull Request #2783