[YARN-3602] TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

• Type: Test
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
• Component/s: test
• Labels: BB2015-05-RFC
• Assignee: Zhihai Xu
• Reporter: Zhihai Xu
• Created: 08/May/15 16:04
• Updated: 30/Aug/16 01:22
• Resolved: 09/May/15 00:55

Description

ResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. The stack trace is the following from test report at
https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/

Error Message
Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
Stacktrace
java.io.IOException: Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
	at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
	at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
	at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
	at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)

It looks like we can safely ignore the IOException in cleanup which is called after test.
The IOException may be due to the test machine environment because TestResourceLocalizationService/2/filecache is created by ResourceLocalizationService#initializeLocalDir.
testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 2/filecache and 3/filecache

    for (int i = 0; i < 4; ++i) {
      localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
      sDirs[i] = localDirs.get(i).toString();
    }

Issue Links

• is related to: YARN-5463 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup
• relates to: YARN-4717 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup