Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When run on Windows + cygwin, chmod fails because it fails to call makeShellPath on the parameter.
      The strack trace with 0.19.1 below:

      org.apache.hadoop.util.Shell$ExitCodeException: chmod: changing permissions of `C:\\files\\hudson\\hadoop\\task-tracker\\taskTracker\\jobcache\\job_200908191713_0008\\job.xml': No such file or directory
      
      	at org.apache.hadoop.util.Shell.runCommand(Shell.java:195)
      	at org.apache.hadoop.util.Shell.run(Shell.java:134)
      	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286)
      	at org.apache.hadoop.util.Shell.execCommand(Shell.java:338)
      	at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:540)
      	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:532)
      	at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:274)
      	at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:364)
      	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)
      	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:468)
      	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:375)
      	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:208)
      	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
      	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1214)
      	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1195)
      	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:750)
      	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1656)
      	at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:102)
      	at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1621)
      
      1. HDFS-569.diff
        0.7 kB
        Kohsuke Kawaguchi

        Activity

        Hide
        Lance Norskog added a comment -

        Please revive this effort.

        Thanks!

        Show
        Lance Norskog added a comment - Please revive this effort. Thanks!
        Hide
        Kohsuke Kawaguchi added a comment -

        HDFS-197 addresses the DU/DF problem.

        Show
        Kohsuke Kawaguchi added a comment - HDFS-197 addresses the DU/DF problem.
        Hide
        Vinod Kumar Vavilapalli added a comment -

        A quick look at DF.java and DU.java shows that they may also result in this same exception. Can you check it by running the DF and DU classes directly?

        Show
        Vinod Kumar Vavilapalli added a comment - A quick look at DF.java and DU.java shows that they may also result in this same exception. Can you check it by running the DF and DU classes directly?
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 patch looks good.

        We should move this issue to Hadoop Common, where the RawLocalFileSystem belongs to. Would you mind also create a patch for trunk?

        Show
        Tsz Wo Nicholas Sze added a comment - +1 patch looks good. We should move this issue to Hadoop Common, where the RawLocalFileSystem belongs to. Would you mind also create a patch for trunk?
        Hide
        Kohsuke Kawaguchi added a comment -

        Patch to fix the problem.

        Show
        Kohsuke Kawaguchi added a comment - Patch to fix the problem.

          People

          • Assignee:
            Kohsuke Kawaguchi
            Reporter:
            Kohsuke Kawaguchi
          • Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development