[HADOOP-18570] AWS SDK V2 - Update region logic

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Ahmar Suhail
• Created: 12/Dec/22 10:01
• Updated: 17/May/23 15:32
• Resolved: 17/May/23 15:32

Description

SDK V2 will no longer resolve a buckets region if it is not set when initialising the client. 

 

Current logic will always make a head bucket call on FS initialisation. We should review this. Possible solution:

• Warn if region is not set.
• If no region, try and resolve. If resolution fails, throw an exception. Cache the region to optimise for short lived FS.