[ARROW-9675] the table does not load if the file path has a dot at start

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.0
• Component/s: Python
• Labels: read table
• Environment: Windows 10
• Flags: Important
• External issue URL: https://github.com/apache/arrow/issues/25732
• Assignee: Ben Kietzman
• Reporter: Praveen Kulkarni
• Created: 09/Aug/20 03:47
• Updated: 11/Jan/23 11:08
• Resolved: 09/Aug/20 05:58

Description

Please check the below code. If I uncomment line six then the table written to disk is loaded as an empty table.

Similar behavior is observed when the directory name starts with `_`. 

This was not the case in earlier versions.

 

```python

import pyarrow.parquet as pq
import pyarrow as pa
import pathlib
_path = pathlib.Path("abc").resolve()
_path /= "xyz"
_path /= ".lmn" # uncomment this has a 'dot' at start of the folder
_path /= "file_name"
pq.write_to_dataset(
    table=pa.table(

{"a": [1], "b": [2]}

),
    root_path=_path.as_posix()
)
t = pq.read_table(_path)
print(t.to_pandas())

```

Issue Links

• duplicates: ARROW-9644 [C++][Dataset] Do not check for ignore_prefixes in the base path