Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10191

Missing executable permission on viewfs internal dirs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: viewfs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      ViewFileSystem allows 1) unconditional listing of internal directories (mount points) and 2) and changing work directories.

      1) requires read permission
      2) requires executable permission

      However, the hardcoded PERMISSION_RRR == 444 for FileStatus representing an internal dir does not have executable bit set.

      This confuses YARN localizer for public resources on viewfs because it requires executable permission for "other" on all of the ancestor directories of the resource.

      java.io.IOException: Resource viewfs:/pubcache/cache.txt is not publicly accessable and as such cannot be part of the public cache.
              at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:182)
              at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:51)
              at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:279)
              at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:277)
      

        Attachments

        1. HADOOP-10191.v01.patch
          11 kB
          Gera Shegalov

          Issue Links

            Activity

              People

              • Assignee:
                jira.shegalov Gera Shegalov
                Reporter:
                jira.shegalov Gera Shegalov
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: