Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14476

make InconsistentAmazonS3Client usable in downstream tests

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HADOOP-13345
    • Fix Version/s: HADOOP-13345
    • Component/s: fs/s3, test
    • Labels:
      None

      Description

      It's important for downstream apps to be able to verify that s3guard works by making the AWS client inconsistent (so demonstrate problems), then turn s3guard on to verify that they go away.

      This can be done by exposing the InconsistentAmazonS3Client

      1. move the factory to the production source
      2. make delay configurable for when you want a really long delay
      3. have factory code log @ warn when a non-default factory is used.
      4. mention in s3a testing.md

      I think we could look at the name of the option, fs.s3a.s3.client.factory.impl too. I'd like something which has "internal" in it, and without the duplication of s3a.s3

        Attachments

        1. HADOOP-14476-HADOOP-13345.004.patch
          35 kB
          Aaron Fabbri
        2. HADOOP-14476-HADOOP-13345.003.patch
          36 kB
          Aaron Fabbri
        3. HADOOP-14476-HADOOP-13345.002.patch
          35 kB
          Aaron Fabbri
        4. HADOOP-14476-HADOOP-13345.001.patch
          19 kB
          Aaron Fabbri

          Activity

            People

            • Assignee:
              fabbri Aaron Fabbri
              Reporter:
              stevel@apache.org Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: