[HADOOP-16838] Support for `fs.s3a.endpoint.region`

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Works for Me
• Assignee: Unassigned
• Reporter: Nitish
• Created: 04/Feb/20 13:02
• Updated: 09/Feb/20 15:31
• Resolved: 04/Feb/20 13:28

Description

Currently it is not possible to connect S3 Compatible services like MinIO, Ceph, etc (running with a custom region) to Spark with s3a connector. For example, if MinIO is running on a Server with

• IP Address: 192.168.0.100
• Region: ap-southeast-1

The s3a connector can't be configured to use the region `ap-southeast-1`. 

It would be great to have a configuration field like `fs.s3a.endpoint.region`. This will be very helpful for users deploying Private Cloud and who intend to use S3 like services on premises.

Issue Links

• duplicates: HADOOP-11261 Set custom endpoint for S3A