[ARROW-428] [Python] Deserialize from Arrow record batches to pandas in parallel using a thread pool

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2.0
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/16076
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 19/Dec/16 15:25
• Updated: 11/Jan/23 07:08
• Resolved: 28/Dec/16 12:49

Description

By default to_pandas can use multiprocessing.cpu_count() to select a number of threads.

Issue Links

• relates to: ARROW-432 [Python] Avoid unnecessary memory copy in to_pandas conversion by using low-level pandas internals APIs