[ARROW-3928] [Python] Add option to deduplicate PyBytes / PyString / PyUnicode objects in Table.to_pandas conversion path

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/20538
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 02/Dec/18 19:16
• Updated: 11/Jan/23 07:30
• Resolved: 27/Dec/18 18:18

Description

While hashing carries a performance penalty, the memory savings can be huge. See also ARROW-3911 – we should develop some reusable machinery for conversions that yield Python objects

Issue Links

• relates to: ARROW-3911 [Python] Deduplicate datetime.date objects in Table.to_pandas internals
• links to: GitHub Pull Request #3257