Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1020

Path class on Windows seems broken

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.1
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None

      Description

      Executing this code:

      Path file = new Path("file:///", "C:/trunk/build/test/data"); or Path file = new Path("C:/trunk/build/test/data");
      FileSystem fs = file.getFileSystem(conf);
      fs.mkdirs(file))

      produces this exception. It looks like it's defaulting to the DistributedFileSystem.

      2007-02-14 11:36:31,700 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(296)) - Error from task_0001_m_000000_0: java.lang.IllegalArgumentException: Pathname /C:/trunk/build/test/data from C:/trunk/build/test/data is not a valid DFS filename.
      at org.apache.hadoop.dfs.DistributedFileSystem.getPath(DistributedFileSystem.java:111)
      at org.apache.hadoop.dfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:211)
      at org.apache.hadoop.mapred.MRCaching$MapClass.configure(MRCaching.java:68)
      at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
      at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
      at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:50)
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:70)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:178)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1396)

        Attachments

        1. TestPath.java.patch
          1 kB
          Nigel Daley
        2. HADOOP-1020.patch
          2 kB
          Doug Cutting
        3. HADOOP-1020-2.patch
          3 kB
          Doug Cutting

          Activity

            People

            • Assignee:
              cutting Doug Cutting
              Reporter:
              nidaley Nigel Daley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: