Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Invalid
-
None
-
None
-
None
Description
Implement an S3A access policy that provides strong consistency and improved performance by using the metadata store as the source of truth for metadata operations. In many cases, this will allow S3A to short-circuit calls to S3. Assuming shorter latency for calls to the metadata store compared to S3, we expect this will improve overall performance. With this policy, a client may not be capable of reading data loaded into an S3 bucket by external tools that don't integrate with the metadata store. Users need to be made aware of this limitation.