Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13793

s3guard: add inconsistency injection, integration tests

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HADOOP-13345
    • Component/s: fs/s3
    • Labels:
      None

      Description

      Many of us share concerns that testing the consistency features of S3Guard will be difficult if we depend on the rare and unpredictable occurrence of actual inconsistency in S3 to exercise those code paths.

      I think we should have a mechanism for injecting failure to force exercising of the consistency codepaths in S3Guard.

      Requirements:

      • Integration tests that cause S3A to see the types of inconsistency we address with S3Guard.
      • These are deterministic integration tests.

      Unit tests are possible as well, if we were to stub out the S3Client. That may be less bang for the buck, though.

        Attachments

        1. HADOOP-13793-HADOOP-13345.001.patch
          30 kB
          Aaron Fabbri
        2. HADOOP-13793-HADOOP-13345.002.patch
          31 kB
          Aaron Fabbri
        3. HADOOP-13793-HADOOP-13345.003.patch
          30 kB
          Aaron Fabbri

          Issue Links

            Activity

              People

              • Assignee:
                fabbri Aaron Fabbri
                Reporter:
                fabbri Aaron Fabbri
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: