[HADOOP-16646] Backport S3A enhancements and fixes from trunk to branch-3.2

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.1
• Component/s: fs, fs/s3
• Labels: pull-request-available
• Target Version/s: 3.2.3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 09/Oct/19 15:56
• Updated: 13/Oct/20 14:02

Description

Backport all the stable features from hadoop-aws in trunk to branch-3.2

Note. we've already pulled most of these into CDP, so they have had integration testing already done, though there may be some differences in dependencies (guava, mockito etc)

Issue Links

• relates to: HADOOP-15619 Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features
• relates to: HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
• links to: GitHub Pull Request #1836