Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2600

When used with HDFS federation(viewfs) ,tez will throw a error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.6.0, 0.5.3, 0.7.0, 0.6.1
    • 0.6.2, 0.8.0-alpha, 0.7.1
    • None
    • None
    • cdh5.3.2 federation+ha
      tez-0.6.0

    Description

      When I execute the exapmle of tez,orderedwordcount ,Tez throw a error

      java.lang.IllegalArgumentException: Wrong FS: hdfs://SunshineNameNode2/user/wang/tez-0.6.0.tar.gz, expected: viewfs://nsX/
              at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:645)
              at org.apache.hadoop.fs.viewfs.ViewFileSystem.getUriPath(ViewFileSystem.java:117)
              at org.apache.hadoop.fs.viewfs.ViewFileSystem.getFileStatus(ViewFileSystem.java:346)
              at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1413)
              at org.apache.tez.client.TezClientUtils.getLRFileStatus(TezClientUtils.java:130)
              at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:179)
              at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:757)
              at org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:725)
              at org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:703)
              at org.apache.tez.client.TezClient.submitDAG(TezClient.java:383)
              at org.apache.tez.examples.OrderedWordCount.run(OrderedWordCount.java:208)
              at org.apache.tez.examples.OrderedWordCount.run(OrderedWordCount.java:232)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.tez.examples.OrderedWordCount.main(OrderedWordCount.java:240)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:606)
              at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
              at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
              at org.apache.tez.examples.ExampleDriver.main(ExampleDriver.java:61)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:606)
              at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
      
      

      Attachments

        1. TEZ-2600.0.patch.txt
          2 kB
          Xiaowei Wang
        2. TEZ-2600.1.patch.txt
          1 kB
          Xiaowei Wang
        3. TEZ-2600.2.patch.txt
          0.8 kB
          Xiaowei Wang
        4. TEZ-2600.3.patch.txt
          0.8 kB
          Xiaowei Wang

        Activity

          People

            wisgood Xiaowei Wang
            wisgood Xiaowei Wang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: