Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1373

checkPath() throws IllegalArgumentException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.12.3
    • 0.17.0
    • fs
    • None
    • Windows, Linux

    • Reviewed

    Description

      This was introduced recently in one of the patches committed around 05/15 or 05/14.
      I am running TestDFSIO on a two node cluster. Here is the exception I get

      07/05/15 19:14:53 INFO mapred.TaskInProgress: Error from task_0001_m_000007_0: java.lang.IllegalArgumentException: Wrong FS: hdfs://MY-HOST:7017/benchmarks/TestDFSIO/io_control/in_file_test_io_7, expected: hdfs://my-host:7017
      at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:230)
      at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.getPath(DistributedFileSystem.java:110)
      at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.exists(DistributedFileSystem.java:170)
      at org.apache.hadoop.fs.FilterFileSystem.exists(FilterFileSystem.java:168)
      at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:335)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1162)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1156)
      at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:40)
      at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:54)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:149)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1709)

      I confess, my config on one of the machines specifies name-node "MY-HOST:7017" and on the other one "my-host:7017".
      But that was acceptable before and should stay that way in the future afaiu.

      Attachments

        1. 1373.patch
          1 kB
          Edward J. Yoon
        2. 1373_v05.patch
          3 kB
          Edward J. Yoon
        3. 1373_v04.patch
          3 kB
          Raghu Angadi
        4. 1373_v04.patch
          3 kB
          Raghu Angadi
        5. 1373_v03.patch
          2 kB
          Edward J. Yoon
        6. 1373_v02.patch
          2 kB
          Edward J. Yoon

        Activity

          People

            udanax Edward J. Yoon
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: