Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13451

S3Guard: Implement access policy using metadata store as source of truth.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      Implement an S3A access policy that provides strong consistency and improved performance by using the metadata store as the source of truth for metadata operations. In many cases, this will allow S3A to short-circuit calls to S3. Assuming shorter latency for calls to the metadata store compared to S3, we expect this will improve overall performance. With this policy, a client may not be capable of reading data loaded into an S3 bucket by external tools that don't integrate with the metadata store. Users need to be made aware of this limitation.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              cnauroth Chris Nauroth
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: