Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2198 Remove the need to run NodeManager as privileged account for Windows Secure Container Executor
  3. YARN-2587

Windows Secure Container Executor: classpath in the job classpath-jar is referencing NM nmPrivate files

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • None
    • None
    • nodemanager

    Description

      The classpath-jar is referencing nmPrivate files:

      Manifest-Version: 1.0
      Class-Path: file:/c:/Hadoop/Data/Hadoop/local/usercache/HadoopUser/app
       cache/application_1411394968079_0006/container_1411394968079_0006_01_ 000003 file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/etc/hadoop/ file:/c:/had oop/hadoop-2.4.1-SNAPSHOT/share/hadoop/common/hadoop-common-3.0.0-SNA PSHOT-tests.jar file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/share/hadoop/co
      ...
      file:/c:/Hadoop/Data/Hadoop/local
       /nmPrivate/application_1411394968079_0006/container_1411394968079_000 6_01_000003/job.jar/job.jar file:/c:/Hadoop/Data/Hadoop/local/nmPriva
       te/application_1411394968079_0006/container_1411394968079_0006_01_000 003/job.jar/classes/
      

      This is not allowed in the WSCE enviornment, the container has no read privileges on the nmPrivate paths. Besides that particular jar is copied over into the user appcache.

      Attachments

        1. YARN-2587.1.patch
          5 kB
          Remus Rusanu

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rusanu Remus Rusanu
            rusanu Remus Rusanu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment