[HADOOP-13447] Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha2
• Component/s: fs/s3
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth Assign to me
• Reporter: Chris Nauroth
• Created: 01/Aug/16 23:57
• Updated: 09/Feb/20 15:50
• Resolved: 06/Sep/16 16:48

Description

The scope of this issue is to refactor the existing S3AFileSystem into multiple coordinating classes. The goal of this refactoring is to separate the FileSystem API binding from the AWS SDK integration, make code maintenance easier while we're making changes for S3Guard, and make it easier to mock some implementation details so that tests can simulate eventual consistency behavior in a deterministic way.

Issue Links

• is required by: HADOOP-13452 S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.
• requires: HADOOP-13446 Support running isolated unit tests separate from AWS integration tests.