Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13447

Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha2
    • fs/s3
    • None
    • Reviewed

    Description

      The scope of this issue is to refactor the existing S3AFileSystem into multiple coordinating classes. The goal of this refactoring is to separate the FileSystem API binding from the AWS SDK integration, make code maintenance easier while we're making changes for S3Guard, and make it easier to mock some implementation details so that tests can simulate eventual consistency behavior in a deterministic way.

      Attachments

        1. HADOOP-13447-HADOOP-13446.001.patch
          152 kB
          Chris Nauroth
        2. HADOOP-13447-HADOOP-13446.002.patch
          48 kB
          Chris Nauroth
        3. HADOOP-13447.003.patch
          42 kB
          Chris Nauroth
        4. HADOOP-13447.004.patch
          384 kB
          Chris Nauroth
        5. HADOOP-13447.005.patch
          42 kB
          Chris Nauroth

        Issue Links

          is required by

          Sub-task - The sub-task of the issue HADOOP-13452 S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

          • Major - Major loss of function.
          • Resolved
          requires

          Sub-task - The sub-task of the issue HADOOP-13446 Support running isolated unit tests separate from AWS integration tests.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: