[HDDS-10615] ETag change detected in S3A contract test

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0, 1.4.1
• Component/s: S3
• Labels: pull-request-available
• Target Version/s: 1.4.1
• Assignee: Attila Doroszlai Assign to me
• Reporter: Attila Doroszlai
• Created: 29/Mar/24 18:43
• Updated: 16/Aug/24 04:53
• Resolved: 16/Apr/24 12:44

Description

Tests run: 11, Failures: 0, Errors: 3, Skipped: 1, Time elapsed: 2.998 s <<< FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename
testRenamePopulatesFileAncestors2(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)  Time elapsed: 1.04 s  <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy `s3a://obs-bucket/test/testRenamePopulatesFileAncestors2/src/dir1/dir2/dir3/fileA': ETag change detected on client during copy. Expected 2024-03-29T18:34:05.086Z got f41ee8006d26bd7fc73828b0a0b350a8
	at org.apache.hadoop.fs.s3a.impl.ChangeDetectionPolicy.onChangeDetected(ChangeDetectionPolicy.java:317)
	at org.apache.hadoop.fs.s3a.impl.ChangeTracker.processNewRevision(ChangeTracker.java:288)
	at org.apache.hadoop.fs.s3a.impl.ChangeTracker.processMetadata(ChangeTracker.java:260)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$11(S3AFileSystem.java:2667)
	at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:468)
	at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2653)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$copyFile$29(S3AFileSystem.java:4271)
	at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:122)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:4269)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.access$1300(S3AFileSystem.java:266)
	at org.apache.hadoop.fs.s3a.S3AFileSystem$OperationCallbacksImpl.copyFile(S3AFileSystem.java:2285)
	at org.apache.hadoop.fs.s3a.impl.RenameOperation.copySource(RenameOperation.java:562)

testRenameWithNonEmptySubDir(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)  Time elapsed: 0.281 s  <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy `s3a://obs-bucket/test/testRenameWithNonEmptySubDir/src1/source.txt': ETag change detected on client during copy. Expected 2024-03-29T18:34:05.352Z got 046d1988b7a01316bb47905ccf3b584a

testRenamePopulatesFileAncestors(org.apache.hadoop.fs.contract.s3a.ITestS3AContractRename)  Time elapsed: 0.219 s  <<< ERROR!
org.apache.hadoop.fs.s3a.RemoteFileChangedException: copy `s3a://obs-bucket/test/testRenamePopulatesFileAncestors/source/dir1/dir2/dir3/file4': ETag change detected on client during copy. Expected 2024-03-29T18:34:05.609Z got 67e95334b751fbfc6570e8228183c074


Tests run: 4, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 1.314 s <<< FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag
testLocatedStatusAlsoHasEtag(org.apache.hadoop.fs.contract.s3a.ITestS3AContractEtag)  Time elapsed: 0.117 s  <<< FAILURE!
org.junit.ComparisonFailure: [etag of listLocatedStatus (S3ALocatedFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src; isDirectory=false; length=11; replication=1; blocksize=33554432; modification_time=1711737272164; access_time=0; owner=...; group=...; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false}[eTag='2024-03-29T18:34:32.164Z', versionId='']) compared to HEAD value of S3AFileStatus{path=s3a://obs-bucket/test/testLocatedStatusAlsoHasEtag/src; isDirectory=false; length=11; replication=1; blocksize=33554432; modification_time=1711737272000; access_time=0; owner=...; group=...; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=26e078b87fdaa3206ab8bf63a6096c07 versionId=null] expected:<"2[6e078b87fdaa3206ab8bf63a6096c07]"> but was:<"2[024-03-29T18:34:32.164Z]">
  ...
  at org.apache.hadoop.fs.contract.AbstractContractEtagTest.testLocatedStatusAlsoHasEtag(AbstractContractEtagTest.java:186)

Issue Links

• causes: HDDS-10719 Empty ETag for key created outside of S3
• requires: HDDS-8450 Dedicated acceptance test suite for s3a
• links to: GitHub Pull Request #6519