[ARROW-822] [Python] StreamWriter fails to open with socket as sink

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/16430
• Assignee: Bryan Cutler
• Reporter: Bryan Cutler
• Created: 14/Apr/17 17:04
• Updated: 11/Jan/23 07:11
• Resolved: 21/Apr/17 01:43

Description

Trying to use pyarrow StreamWriter to write to a socket fails. I've tried the following:

• Use socket directly and get "TypeError: Unable to read from object of type: <class 'socket._socketobject'>"
  looks like pyarrow expects the object to have a "write" attribute

• Using as a file object with: "sock.makefile("wb", 65536)" get the error "pyarrow.error.ArrowIOError: IOError: '_fileobject' object has no attribute 'tell'"
  Not sure why exactly "tell" is required.

• using "os.fdopen(sock.fileno(), "wb", 65536)" get a rather cryptic error that I've been unable to track down:
  "terminate called after throwing an instance of 'std::logic_error' what(): basic_string::_M_construct null not valid"
  Seems to indicate some kind of std::string construction with a NULL, but I can't find that anywhere

Issue Links

• blocks: ARROW-670 Arrow 0.3 release