[ARROW-14930] [C++][Python] FileNotFound with Scality accessed through S3 APIs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 6.0.1
• Fix Version/s: 7.0.0
• Component/s: C++, Python
• Labels: pull-request-available s3
• Environment: linux + python 3.8
• External issue URL: https://github.com/apache/arrow/issues/30454
• Assignee: Antoine Pitrou
• Reporter: Luis Morales
• Created: 30/Nov/21 16:46
• Updated: 11/Jan/23 08:43
• Resolved: 20/Dec/21 11:42

Description

When using dataset.Dataset with S3FileSystem with compatible S3 object sotrage, get an FileNotFoundError.

 

My code:

 

scality = fs.S3FileSystem(access_key='accessKey1', secret_key='verySecretKey1', endpoint_override="http://localhost:8000", region="")

data = ds.dataset("dasynth/parquet/taxies/2019_june/", format="parquet", partitioning="hive", filesystem=scality)

Issue Links

• links to: GitHub Pull Request #11977