Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16319

S3A Etag tests fail with default encryption enabled on bucket

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.2.1
    • Fix Version/s: 3.3.1
    • Component/s: fs/s3, test
    • Labels:
      None

      Description

      I recently updated a bucket I use for hadoop-aws maven testing to enable default encryption.  After doing so, I noticed these two tests failing:

      [INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
      [ERROR] Tests run: 12, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 35.097 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
      [ERROR] testEmptyFileChecksums(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.503 s <<< FAILURE!
      java.lang.AssertionError: checksums expected:<etag: "35ce921ee8c01e6c2ca15d4c44f3cbde"> but was:<etag: "18677de776ff748ef9dbeb0d906e9fdc">
      at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testEmptyFileChecksums(ITestS3AMiscOperations.java:147)
      
      [ERROR] testNonEmptyFileChecksumsUnencrypted(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.145 s <<< FAILURE!
      java.lang.AssertionError: checksums expected:<etag: "bedaf4e62dbcd7c57bd2bb784ace06d0"> but was:<etag: "4b97915374221d1e3d2ffb20562c8867">
      at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted(ITestS3AMiscOperations.java:199)

      I haven't looked in detail at the tests yet but it seems they should either be updated such that they can succeed or be skipped when default encryption is enabled or documentation for running the tests should contain instructions to use a bucket without default encryption.

        Attachments

          Activity

            People

            • Assignee:
              ben.roling Ben Roling
              Reporter:
              ben.roling Ben Roling
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: