[PARQUET-517] [C++] Use arrow::MemoryPool for all heap allocations

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: cpp-4.0.0
• Component/s: parquet-cpp
• Labels: pull-request-available
• Assignee: Zherui Cao
• Reporter: Wes McKinney
• Created: 09/Feb/16 16:02
• Updated: 23/Jun/24 03:28
• Resolved: 19/Nov/18 19:25

Description

We are using std::vector in many places for memory allocation; if we want to use SSE on this memory we may run into some problems.

Couple things we should do

• Add an STL allocator for std::vector that ensure 16-byte aligned memory
• Check user-provided memory for alignment before utilizing an SSE-accelerated routine (e.g. SSE hash functions for dictionary encoding) and decide whether to copy and use SSE or no-copy and use no-SSE code.

Issue Links

• links to: GitHub Pull Request #5496