[ARROW-7280] Flight Data Store : memory mapped file [JAVA and Python]

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Component/s: Documentation, Java, Python
• External issue URL: https://github.com/apache/arrow/issues/23569
• Assignee: Unassigned
• Reporter: Vinay
• Created: 29/Nov/19 17:55
• Updated: 11/Jan/23 07:52
• Resolved: 30/Jan/20 15:54

Description

There are limited references for Arrow Flight implementation/examples for DataStores.

For holding huge data it may require to choose memory mapped file/file system instead of unsafe memory buffer.

It will be great if any there is any reference in this direction for JAVA and Python API.

 

And also the possibility if this is feasible with performance.