[ARROW-10558] [Python] Filesystem S3 tests not independent (native s3 influences s3fs)

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26523
• Assignee: Joris Van den Bossche
• Reporter: Joris Van den Bossche
• Created: 11/Nov/20 13:50
• Updated: 11/Jan/23 08:14
• Resolved: 12/Nov/20 18:13

Description

The filesystem tests in test_fs.py that are parametrized with all the tested filesystems have some "state" shared between them, at least in the case of S3.

When first a test is run with our own S3FileSystem, which eg creates a directory, this directory is still present when we test the s3fs wrapped filesystem, which causes some tests to pass that would otherwise fail if run in isolation.

Issue Links

• links to: GitHub Pull Request #8638