Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3602

TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

    Details

      Description

      ResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. The stack trace is the following from test report at
      https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/

      Error Message
      Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
      Stacktrace
      java.io.IOException: Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
      	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
      	at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
      	at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
      	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
      	at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
      	at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
      	at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
      	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
      

      It looks like we can safely ignore the IOException in cleanup which is called after test.
      The IOException may be due to the test machine environment because TestResourceLocalizationService/2/filecache is created by ResourceLocalizationService#initializeLocalDir.
      testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 2/filecache and 3/filecache

          for (int i = 0; i < 4; ++i) {
            localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
            sDirs[i] = localDirs.get(i).toString();
          }
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zxu zhihai xu
                Reporter:
                zxu zhihai xu
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: