[ARROW-7638] [Python] Segfault when inspecting dataset.Source with invalid file/partitioning

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16.0
• Component/s: C++
• Labels: dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/23888
• Assignee: Francois Saint-Jacques
• Reporter: Joris Van den Bossche
• Created: 21/Jan/20 16:17
• Updated: 11/Jan/23 07:55
• Resolved: 23/Jan/20 19:09

Description

Getting a segfault with:

In [1]: import pyarrow.dataset as ds                                                                                                                                                                               

In [2]: !touch test_empty.txt                                                                                                                                                                                      

In [3]: source_factory = ds.source("test_empty.txt", partitioning=ds.partitioning(field_names=['a', 'b']))                                                                                                         

In [4]: source_factory.inspect()                                                                                                                                                                                   
Segmentation fault (core dumped)

Didn't yet further investigate what might be the reason (there are several "wrong" things here: it's an empty file, it's not a valid file for the parquet format, the partitioning does not match the files, etc)

Issue Links

• links to: GitHub Pull Request #6267