Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16319

ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      I recently updated a bucket I use for hadoop-aws maven testing to enable default encryption.  After doing so, I noticed these two tests failing:

      [INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
      [ERROR] Tests run: 12, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 35.097 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
      [ERROR] testEmptyFileChecksums(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.503 s <<< FAILURE!
      java.lang.AssertionError: checksums expected:<etag: "35ce921ee8c01e6c2ca15d4c44f3cbde"> but was:<etag: "18677de776ff748ef9dbeb0d906e9fdc">
      at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testEmptyFileChecksums(ITestS3AMiscOperations.java:147)
      
      [ERROR] testNonEmptyFileChecksumsUnencrypted(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.145 s <<< FAILURE!
      java.lang.AssertionError: checksums expected:<etag: "bedaf4e62dbcd7c57bd2bb784ace06d0"> but was:<etag: "4b97915374221d1e3d2ffb20562c8867">
      at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted(ITestS3AMiscOperations.java:199)

      I haven't looked in detail at the tests yet but it seems they should either be updated such that they can succeed or be skipped when default encryption is enabled or documentation for running the tests should contain instructions to use a bucket without default encryption.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ben.roling Ben Roling
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: