[HADOOP-14013] S3Guard: fix multi-bucket integration tests

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HADOOP-13345
• Fix Version/s: HADOOP-13345
• Component/s: fs/s3
• Target Version/s: HADOOP-13345
• Assignee: Aaron Fabbri
• Reporter: Aaron Fabbri
• Created: 20/Jan/17 19:34
• Updated: 30/Nov/20 11:26
• Resolved: 07/Feb/17 02:03

Description

Clone of HADOOP-13876 to address multi-bucket test failures separately.

One of the issues is with accessing read-only buckets. If a user accesses a read-only bucket with credentials that do not have DynamoDB write permissions, they will get errors when trying to access the read-only bucket. This manifests causes test failures for ITestS3AAWSCredentialsProvider.

Goals for this JIRA:

• Fix ITestS3AAWSCredentialsProvider in a way that makes sense for the real use-case.
• Document limitations etc. in the s3guard.md site doc.

Issue Links

• depends upon: HADOOP-13589 S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.
• is a clone of: HADOOP-13876 S3Guard: better support for multi-bucket access
• is depended upon by: HADOOP-13998 Merge initial S3guard release into trunk
• is related to: HADOOP-13336 S3A to support per-bucket configuration
• is related to: HADOOP-17401 GCS to support per-bucket configuration