[ARROW-1924] [Python] Bring back pickle=True option for serialization

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17915
• Assignee: Philipp Moritz
• Reporter: Philipp Moritz
• Created: 13/Dec/17 23:41
• Updated: 11/Jan/23 07:17
• Resolved: 18/Dec/17 05:35

Description

We need to revert https://issues.apache.org/jira/browse/ARROW-1758

The reason is that the semantics for pickle=True is slightly different from just using (cloud-)pickle as the custom serializer:

If pickle=True is used, the object can be deserialized in any process, even if a deserializer for that type_id has not been registered in that process. On the other hand, if (cloud-)pickle is used as a custom serializer, the object can only be deserialized if pyarrow has the type_id registered and can call the deserializer.

Issue Links

• links to: GitHub Pull Request #1420