[ARROW-6682] [C#] Arrow R/C++ hangs reading binary file generated by C#

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.1
• Fix Version/s: 0.15.0
• Component/s: C#
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/23030
• Assignee: Eric Erhardt
• Reporter: Anthony Abate
• Created: 25/Sep/19 03:42
• Updated: 11/Jan/23 07:48
• Resolved: 29/Sep/19 18:37

Description

I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). (the file has 37 columns)

I have memory dumps - All threads seem to be in wait handles.

Are there debug symbols somewhere? 

Is there a way to get the C++ code to produce diagnostic logging from R? 

 

UPDATE: it seems that the hangs are not related to file size, row counts, or # of record batches, but rather the number of columns

Issue Links

• links to: GitHub Pull Request #5520