[HADOOP-16319] S3A Etag tests fail with default encryption enabled on bucket

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.1
• Fix Version/s: 3.3.0
• Component/s: fs/s3, test
• Assignee: Ben Roling
• Reporter: Ben Roling
• Created: 17/May/19 17:32
• Updated: 17/May/21 04:15
• Resolved: 17/Mar/20 14:13

Description

I recently updated a bucket I use for hadoop-aws maven testing to enable default encryption.  After doing so, I noticed these two tests failing:

[INFO] Running org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
[ERROR] Tests run: 12, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 35.097 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AMiscOperations
[ERROR] testEmptyFileChecksums(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.503 s <<< FAILURE!
java.lang.AssertionError: checksums expected:<etag: "35ce921ee8c01e6c2ca15d4c44f3cbde"> but was:<etag: "18677de776ff748ef9dbeb0d906e9fdc">
at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testEmptyFileChecksums(ITestS3AMiscOperations.java:147)

[ERROR] testNonEmptyFileChecksumsUnencrypted(org.apache.hadoop.fs.s3a.ITestS3AMiscOperations) Time elapsed: 3.145 s <<< FAILURE!
java.lang.AssertionError: checksums expected:<etag: "bedaf4e62dbcd7c57bd2bb784ace06d0"> but was:<etag: "4b97915374221d1e3d2ffb20562c8867">
at org.apache.hadoop.fs.s3a.ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted(ITestS3AMiscOperations.java:199)

I haven't looked in detail at the tests yet but it seems they should either be updated such that they can succeed or be skipped when default encryption is enabled or documentation for running the tests should contain instructions to use a bucket without default encryption.

Issue Links

• links to: GitHub Pull Request #836
• links to: GitHub Pull Request #1897