[ARROW-1391] [Python] Benchmarks for python serialization

• Type: Wish
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Component/s: Benchmarking, Python
• Labels: pyarrow-serialization
• External issue URL: https://github.com/apache/arrow/issues/15456
• Assignee: Unassigned
• Reporter: Philipp Moritz
• Created: 21/Aug/17 00:49
• Updated: 11/Jan/23 07:14
• Resolved: 17/Feb/21 16:04

Description

It would be great to have a suite of relevant benchmarks for the Python serialization code in ARROW-759. These could be used to guide profiling and performance improvements.

Relevant use cases include:

• dictionaries of large numpy arrays that are used to represent weights of a neural network
• long lists of primitive types like ints, floats or strings
• lists of user defined python objects