Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1908

Distributed shell with custom script has permission error.

    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Create test1.sh having "pwd".

      Run this command as user1:
      hadoop jar /usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar -jar /usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar -shell_script test1.sh

      NM is run by yarn user. An exception is thrown because yarn user has no permissions on custom script in hdfs path. The custom script is created with distributed shell app.

      Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=yarn, access=WRITE, inode="/user/user1/DistributedShell/70":user1:user1:drwxr-xr-x
      	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
      

        Attachments

        1. YARN-1908.4.patch
          8 kB
          Vinod Kumar Vavilapalli
        2. YARN-1908.3.patch
          6 kB
          Jian He
        3. YARN-1908.2.patch
          5 kB
          Jian He
        4. YARN-1908.1.patch
          3 kB
          Jian He

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              tassapola Tassapol Athiapinya
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: