Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2198 Remove the need to run NodeManager as privileged account for Windows Secure Container Executor
  3. YARN-2587

Windows Secure Container Executor: classpath in the job classpath-jar is referencing NM nmPrivate files

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:

      Description

      The classpath-jar is referencing nmPrivate files:

      Manifest-Version: 1.0
      Class-Path: file:/c:/Hadoop/Data/Hadoop/local/usercache/HadoopUser/app
       cache/application_1411394968079_0006/container_1411394968079_0006_01_ 000003 file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/etc/hadoop/ file:/c:/had oop/hadoop-2.4.1-SNAPSHOT/share/hadoop/common/hadoop-common-3.0.0-SNA PSHOT-tests.jar file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/share/hadoop/co
      ...
      file:/c:/Hadoop/Data/Hadoop/local
       /nmPrivate/application_1411394968079_0006/container_1411394968079_000 6_01_000003/job.jar/job.jar file:/c:/Hadoop/Data/Hadoop/local/nmPriva
       te/application_1411394968079_0006/container_1411394968079_0006_01_000 003/job.jar/classes/
      

      This is not allowed in the WSCE enviornment, the container has no read privileges on the nmPrivate paths. Besides that particular jar is copied over into the user appcache.

        Attachments

        1. YARN-2587.1.patch
          5 kB
          Remus Rusanu

          Issue Links

            Activity

              People

              • Assignee:
                rusanu Remus Rusanu
                Reporter:
                rusanu Remus Rusanu
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: