Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9675

the table does not load if the file path has a dot at start

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0
    • Fix Version/s: None
    • Component/s: Python
    • Labels:
    • Environment:
      Windows 10
    • Flags:
      Important

      Description

      Please check the below code. If I uncomment line six then the table written to disk is loaded as an empty table.

      Similar behavior is observed when the directory name starts with `_`. 

      This was not the case in earlier versions.

       

      ```python

      import pyarrow.parquet as pq
      import pyarrow as pa
      import pathlib
      _path = pathlib.Path("abc").resolve()
      _path /= "xyz"
      _path /= ".lmn" # uncomment this has a 'dot' at start of the folder
      _path /= "file_name"
      pq.write_to_dataset(
          table=pa.table(

      {"a": [1], "b": [2]}

      ),
          root_path=_path.as_posix()
      )
      t = pq.read_table(_path)
      print(t.to_pandas())

      ```

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bkietz Ben Kietzman
                Reporter:
                spikingneuron Praveen Kulkarni
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: