[ARROW-11049] [Python] Expose alternate memory pools

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26965
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 28/Dec/20 17:43
• Updated: 11/Jan/23 08:17
• Resolved: 12/Jan/21 15:57

Description

Currently, the default memory pool is exposed in Python but not the explicit memory pool singletons (jemalloc, mimalloc, system).

 

Issue Links

• relates to: ARROW-9974 [Python][C++] pyarrow version 1.0.1 throws Out Of Memory exception while reading large number of files using ParquetDataset
• links to: GitHub Pull Request #9161