Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13447

Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha2
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The scope of this issue is to refactor the existing S3AFileSystem into multiple coordinating classes. The goal of this refactoring is to separate the FileSystem API binding from the AWS SDK integration, make code maintenance easier while we're making changes for S3Guard, and make it easier to mock some implementation details so that tests can simulate eventual consistency behavior in a deterministic way.

        Attachments

        1. HADOOP-13447.003.patch
          42 kB
          Chris Nauroth
        2. HADOOP-13447.004.patch
          384 kB
          Chris Nauroth
        3. HADOOP-13447.005.patch
          42 kB
          Chris Nauroth
        4. HADOOP-13447-HADOOP-13446.001.patch
          152 kB
          Chris Nauroth
        5. HADOOP-13447-HADOOP-13446.002.patch
          48 kB
          Chris Nauroth

          Issue Links

            Activity

              People

              • Assignee:
                cnauroth Chris Nauroth
                Reporter:
                cnauroth Chris Nauroth
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: