[ARROW-1214] [Python] Add classes / functions to enable stream message components to be handled outside of the stream reader class

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/17004
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 13/Jul/17 17:25
• Updated: 11/Jan/23 07:13
• Resolved: 15/Jul/17 20:52

Description

This will be helpful in messaging / RPC scenarios where the message components are sent in multiple streams (e.g. schema negotation first, then record batches later)

• Class for holding a single serialized message, able to indicate what kind of message it is
• Read schema from list of one or more messages (if there are dictionaries, there will be multiple messages, otherwise only one)
• Read record batch from a message given the schema

Issue Links

• relates to: ARROW-1047 [Java] Add generalized stream writer and reader interfaces that are decoupled from IO / message framing