Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1386

NodeManager mistakenly loses resources and relocalizes them

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.10, 2.2.0
    • Fix Version/s: 0.23.10, 2.3.0
    • Component/s: nodemanager
    • Labels:
      None

      Description

      When a local resource that should already be present is requested again, the nodemanager checks to see if it still present. However the method it uses to check for presence is via File.exists() as the user of the nodemanager process. If the resource was a private resource localized for another user, it will be localized to a location that is not accessible by the nodemanager user. Therefore File.exists() returns false, the nodemanager mistakenly believes the resource is no longer available, and it proceeds to localize it over and over.

        Attachments

        1. YARN-1386.patch
          5 kB
          Jason Darrell Lowe
        2. YARN-1386.patch
          5 kB
          Jason Darrell Lowe

          Activity

            People

            • Assignee:
              jlowe Jason Darrell Lowe
              Reporter:
              jlowe Jason Darrell Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: