[HADOOP-13452] S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HADOOP-13345
• Component/s: fs/s3
• Target Version/s: HADOOP-13345
• Hadoop Flags: Reviewed
• Assignee: Aaron Fabbri
• Reporter: Chris Nauroth
• Created: 02/Aug/16 00:08
• Updated: 19/Oct/16 23:37
• Resolved: 19/Oct/16 23:37

Description

Implement an S3A access policy based on an in-memory metadata store. This can provide consistency within the same client without needing to integrate with an external system.

Issue Links

• is depended upon by: HADOOP-13631 S3Guard: implement move() for LocalMetadataStore, add unit tests
• relates to: HADOOP-12876 [Azure Data Lake] Support for process level FileStatus cache to optimize GetFileStatus frequent operations
• requires: HADOOP-13448 S3Guard: Define MetadataStore interface.
• requires: HADOOP-13447 Refactor S3AFileSystem to support introduction of separate metadata repository and tests.