[ARROW-10644] [Python] Consolidate path/filesystem handling in pyarrow.dataset and pyarrow.fs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26600
• Assignee: Joris Van den Bossche
• Reporter: Joris Van den Bossche
• Created: 18/Nov/20 15:22
• Updated: 11/Jan/23 08:14
• Resolved: 02/Dec/20 07:22

Description

The pyarrow.dataset module grew some custom code to deal with paths and filesystems, but also the{{pyarrow.fs}} package has some general utilities for this.

Issue Links

• links to: GitHub Pull Request #8704