[HADOOP-18565] AWS SDK V2 - Complete outstanding items

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Component/s: fs/s3
• Labels: pull-request-available
• Assignee: Ahmar Suhail
• Reporter: Ahmar Suhail
• Created: 09/Dec/22 15:34
• Updated: 22/May/23 09:38
• Resolved: 24/Apr/23 16:30

Description

The following work remains to complete the SDK upgrade work:

• S3A allows users configure to custom signers, add in support for this.
• Remove SDK V1 bundle dependency
• Update `getRegion()` logic to use retries. 
• Add in progress listeners for `S3ABlockOutputStream`
• Fix any failing tests.

Issue Links

• links to: GitHub Pull Request #5421