[ARROW-493] [C++] Allow in-memory array over 2^31 -1 elements but require splitting at IPC / RPC boundaries

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/16136
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 18/Jan/17 00:48
• Updated: 11/Jan/23 07:09
• Resolved: 27/Feb/17 07:14

Description

To make Arrow a more flexible container for interacting with foreign data, it will be useful to be able to do zero-copy construction of arrays having a footprint of larger than 2 billion * sizeof(type). When sending such data over the wire, we would need to break it into pieces of at most 2 billion