[ARROW-1104] Integrate in-memory object store from Ray

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/16691
• Assignee: Philipp Moritz
• Reporter: Philipp Moritz
• Created: 08/Jun/17 07:43
• Updated: 11/Jan/23 07:12
• Resolved: 22/Jun/17 13:35

Description

To exchange arrow data between different processes on a machine, it is beneficial to have a shared-memory object store that acts as a server and can ship shared memory regions to clients, handle reference counting, object eviction as well as provide a unified namespace for objects. Such an object store has been developed as part of Ray (https://github.com/ray-project/ray) and this ticket is about integrating it into Arrow.