[HADOOP-16177] regression: ITestS3AMiniYarnCluster failing on branch-3.2

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.2.0
• Component/s: fs/s3, test
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 09/Mar/19 17:39
• Updated: 09/Mar/19 17:56
• Resolved: 09/Mar/19 17:56

Description

The test ITestS3AMiniYarnCluster is failing -the output of the trivial MR job isn't being found.

tS3AMiniYarnCluster
[ERROR] testWithMiniCluster(org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster)  Time elapsed: 8.309 s  <<< ERROR!
java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/test/MiniClusterWordCount/output/part-r-00000
	at org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster.readStringFromFile(ITestS3AMiniYarnCluster.java:144)
	at org.apache.hadoop.fs.s3a.yarn.ITestS3AMiniYarnCluster.testWithMiniCluster(ITestS3AMiniYarnCluster.java:103)

In trunk, HADOOP-14556 moved this test to the new committers, and the problem doesn't surface.

Thought this was related to S3Guard not on, or the fact that a versioned S3 store was in use (S3 london), but it also arises (at least today) on S3 ireland with s3guard and no versioned store.