[ARROW-2575] [Python] Exclude hidden files when reading Parquet dataset

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Python
• Labels: pull-request-available
• Environment: Unix-like systems
• Flags: Patch
• External issue URL: https://github.com/apache/arrow/issues/18947
• Assignee: Wes McKinney
• Reporter: Durmus Karatay
• Created: 11/May/18 15:23
• Updated: 11/Jan/23 07:21
• Resolved: 24/Jul/18 08:34

Description

On Unix systems hidden files are listed because os.walk does not care about hidden files. This especially creates a problem in macOS where .DS_Store files are created automatically.

Issue Links

• links to: GitHub Pull Request #2027
• links to: GitHub Pull Request #2312