[ARROW-8427] [C++][Dataset] Do not ignore file paths with underscore/dot when full path was specified

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.17.0
• Component/s: C++
• Labels: dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/24608
• Assignee: Ben Kietzman
• Reporter: Joris Van den Bossche
• Created: 13/Apr/20 16:26
• Updated: 11/Jan/23 08:00
• Resolved: 14/Apr/20 00:40

Description

Currently, when passing a list of file path to FileSystemDatasetFactory, the files that have one of their parent directories with a underscore or dot are skipped. Since the file paths were passed as an explicit list, we should maybe not skip them.

For example, when specifying a directory (Selector), it will only check child directories to skip, not parent directories.

Issue Links

• links to: GitHub Pull Request #6915