[ARROW-4711] [Plasma] enhance plasma client interfaces to work with multiple objects

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Component/s: C++ - Plasma
• External issue URL: https://github.com/apache/arrow/issues/15997
• Assignee: Unassigned
• Reporter: Zhijun Fu
• Created: 28/Feb/19 06:38
• Updated: 11/Jan/23 07:35
• Resolved: 20/Feb/21 00:23

Description

Right now the Delete() interface in plasma client supports deleting multiple objects in a single shot, so that we can save IPCs (inter-processing communication) between plasma clients and plasma store. This reduces latency for plasma clients, and also improve the actual throughput for plasma store.

I made a simple prototype for changing Release() function as well, when batching release 10 objects in a single IPC, it only takes about 1/6 of the time compared with using 10 separate IPCs. Also from profiling, processing IPCs takes a lot of CPU cycles in plasma store currently, as UNIX domain socket processing needs to go through kernel, thus batching multiple IPCs into a single one should greatly improve the plasma store performance as well.

 

This change mostly applies to Release(), Seal(), and Create() interfaces.