[ARROW-8156] [C++] Add variant of Filesystem::OpenInputFile that has memory-map like behavior if it is possible

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/24360
• Assignee: Unassigned
• Reporter: Wes McKinney
• Created: 18/Mar/20 23:19
• Updated: 11/Jan/23 07:58

Description

TensorFlow has the notion of a ReadOnlyMappedRegion

https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/platform/file_system.h#L106

Rather than toggling memory mapping globally at the LocalFilesystem level, it would be useful for code to be able to request a memory-mapped {[RandomAccessFile}} if memory mapping is possible

See also ARROW-7854

Issue Links

• relates to: ARROW-7854 [C++][Dataset] Option to memory map when reading IPC format