I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). (the file has 37 columns)
I have memory dumps - All threads seem to be in wait handles.
Are there debug symbols somewhere?
Is there a way to get the C++ code to produce diagnostic logging from R?
UPDATE: it seems that the hangs are not related to file size, row counts, or # of record batches, but rather the number of columns