[ARROW-9775] [C++] Automatic S3 region selection

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: C++, Python
• Labels: filesystem pull-request-available
• Environment: macOS, Linux.
• External issue URL: https://github.com/apache/arrow/issues/25824
• Assignee: Antoine Pitrou
• Reporter: Sahil Gupta
• Created: 17/Aug/20 20:17
• Updated: 11/Jan/23 08:08
• Resolved: 21/Sep/20 18:14

Description

Currently, PyArrow and ArrowCpp need to be provided the region of the S3 file/bucket, else it defaults to using 'us-east-1'. Ideally, PyArrow and ArrowCpp can automatically detect the region and get the files, etc. For instance, s3fs and boto3 can read and write files without having to specify the region explicitly. Similar functionality to auto-detect the region would be great to have in PyArrow and ArrowCpp.

Issue Links

• links to: GitHub Pull Request #8205