Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2624

Resource Localization fails on a cluster due to existing cache directories

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.6.0, 2.5.1
    • Fix Version/s: 2.6.0
    • Component/s: nodemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We have found resource localization fails on a cluster with following error in certain cases.

      INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Failed to download rsrc { { hdfs://<blahhostname>:8020/tmp/hive-hive/hive_2014-09-29_14-55-45_184_6531377394813896912-12/-mr-10004/95a07b90-2448-48fc-bcda-cdb7400b4975/map.xml, 1412027745352, FILE, null },pending,[(container_1411670948067_0009_02_000001)],443533288192637,DOWNLOADING}
      java.io.IOException: Rename cannot overwrite non empty destination directory /data/yarn/nm/filecache/27
      	at org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:716)
      	at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:228)
      	at org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:659)
      	at org.apache.hadoop.fs.FileContext.rename(FileContext.java:906)
      	at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:366)
      	at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:59)
      

        Attachments

        1. YARN-2624.001.patch
          10 kB
          Anubhav Dhoot
        2. YARN-2624.001.patch
          10 kB
          Anubhav Dhoot

          Issue Links

            Activity

              People

              • Assignee:
                adhoot Anubhav Dhoot
                Reporter:
                adhoot Anubhav Dhoot
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: