[ARROW-12616] [Python] S3FileSystem OSError when writing to already created bucket

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Works for Me
• Affects Version/s: 4.0.0, 8.0.0
• Fix Version/s: 9.0.0
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/28369
• Assignee: Samuel Sanders
• Reporter: Samuel Sanders
• Created: 30/Apr/21 17:10
• Updated: 11/Jan/23 08:27
• Resolved: 17/Oct/22 14:41

Description

When calling parquet.write_to_dataset with an S3FileSystem, the following error occurs if the bucket already exists:
OSError: When creating bucket 'bucket-name': AWS Error [code 100]: Unable to parse ExceptionName: InvalidLocationConstraint Message: The specified location-constraint is not valid

The S3FileSystem instance was generated based URI and based on region, but both returned the same error.