Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6804

allow FileSystem.copyFromLocalFile() to execute under specified username

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Not A Problem
    • 0.20.2
    • None
    • util
    • None

    Description

      When the user calling FileSystem.copyFromLocalFile() doesn't have permission to write to certain hdfs path:
      Thread [main] (Suspended (exception AccessControlException))
      DFSClient.mkdirs(String, FsPermission) line: 905
      DistributedFileSystem.mkdirs(Path, FsPermission) line: 262
      DistributedFileSystem(FileSystem).mkdirs(Path) line: 1162
      FileUtil.copy(FileSystem, Path, FileSystem, Path, boolean, boolean, Configuration) line: 194
      DistributedFileSystem(FileSystem).copyFromLocalFile(boolean, boolean, Path, Path) line: 1231
      DistributedFileSystem(FileSystem).copyFromLocalFile(boolean, Path, Path) line: 1207
      DistributedFileSystem(FileSystem).copyFromLocalFile(Path, Path) line: 1179
      GridM2mInstallation.copyInputFiles(FlowConfigurations$FlowConf) line: 380

      Passwordless ssh has been setup for current user, tyu, on localhost and user hadoop on hdfs

      FileSystem.copyFromLocalFile() should be able to execute using a different username than effective user on localhost so that AccessControlException can be avoided.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ted_yu Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: