Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3289

Tez Example MRRSleep job does not set Staging dir correctly on secure cluster

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0
    • None
    • None

    Description

      /usr/hdp/current/hadoop-client/bin/hadoop jar /usr/hdp/current/tez-client/tez-tests-<version>.jar mrrsleep -m 1 -r 1 -mt 1000 -rt 1
      java.io.IOException: java.net.URISyntaxException: Expected scheme name at index 0: :///tmp/hrt_qa/staging/1464974420900/dag_job.jar
      	at org.apache.tez.client.TezClientUtils.setupDAGCredentials(TezClientUtils.java:393)
      	at org.apache.tez.client.TezClientUtils.prepareAndCreateDAGPlan(TezClientUtils.java:692)
      	at org.apache.tez.client.TezClientUtils.createApplicationSubmissionContext(TezClientUtils.java:608)
      	at org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:861)
      	at org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:838)
      	at org.apache.tez.client.TezClient.submitDAG(TezClient.java:456)
      	at org.apache.tez.mapreduce.examples.MRRSleepJob.run(MRRSleepJob.java:751)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
      	at org.apache.tez.mapreduce.examples.MRRSleepJob.main(MRRSleepJob.java:399)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
      	at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
      	at org.apache.tez.mapreduce.examples.ExampleDriver.main(ExampleDriver.java:87)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
      Caused by: java.net.URISyntaxException: Expected scheme name at index 0: :///tmp/hrt_qa/staging/1464974420900/dag_job.jar
      	at java.net.URI$Parser.fail(URI.java:2848)
      	at java.net.URI$Parser.failExpecting(URI.java:2854)
      	at java.net.URI$Parser.parse(URI.java:3046)
      	at java.net.URI.<init>(URI.java:746)
      	at org.apache.hadoop.yarn.util.ConverterUtils.getPathFromYarnURL(ConverterUtils.java:81)
      	at org.apache.tez.client.TezClientUtils.setupDAGCredentials(TezClientUtils.java:373)
      	... 21 more
      

      Attachments

        1. TEZ-3289.1.patch
          0.8 kB
          Harish JP
        2. TEZ-3289.0.patch
          1 kB
          Harish JP

        Activity

          People

            harishjp Harish JP
            ssreenivasan Sushmitha Sreenivasan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: