[ARROW-9347] [Python] Tests fail with latest fsspec

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17261
• Assignee: Joris Van den Bossche
• Reporter: Antoine Pitrou
• Created: 07/Jul/20 10:58
• Updated: 11/Jan/23 08:06
• Resolved: 08/Jul/20 12:25

Description

Using the latest fsspec from upstream git repo (changeset 656be423ef36ac533fd3319850e107c2669cce3d), I get this error when running the tests:

Traceback (most recent call last):
  File "/home/antoine/arrow/dev/python/pyarrow/tests/test_fs.py", line 778, in test_move_directory
    fs.move(s, t)
  File "pyarrow/_fs.pyx", line 519, in pyarrow._fs.FileSystem.move
    check_status(self.fs.Move(source, destination))
  File "pyarrow/_fs.pyx", line 1024, in pyarrow._fs._cb_move
    handler.move(frombytes(src), frombytes(dest))
  File "/home/antoine/arrow/dev/python/pyarrow/fs.py", line 173, in move
    self.fs.mv(src, dest)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/fsspec/spec.py", line 743, in mv
    self.rm(path1, recursive=recursive)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/fsspec/implementations/local.py", line 108, in rm
    os.remove(path)
IsADirectoryError: [Errno 21] Is a directory: '/tmp/pytest-of-antoine/pytest-0/test_move_directory_PyFileSyst1/source-dir'

Issue Links

• links to: GitHub Pull Request #7662