Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-22448

Oozie Jobs on Hive Fail With Missing Tarball

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.6 1 (wrong)
    • ambari-server
    • None

    Description

      STR:

      • Install an HDP 2.6.3.0 cluster with Oozie, HIve, MapR, Yarn, ZK, HDFS
      • Patch only Oozie to a new version, such as 2.6.3.1-1
      • Attempt to run an Oozie job on Hive

      The workflow job will fail with:

      org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: hdfs://jhurley-pu-1.openstacklocal:8020/hdp/apps/2.6.3.1-1/mapreduce/mapreduce.tar.gz
      	at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
      	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
      	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1211)
      	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1382)
      	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
      	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
      	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
      	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
      	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      

      This is because Oozie appears to be trying to use a version of the MapReduce tarball which matches its version. However, since it does not ship its version, it cannot find it.

      Attachments

        1. AMBARI-22448.patch
          0.6 kB
          Nate Cole

        Issue Links

          Activity

            People

              ncole@hortonworks.com Nate Cole
              ncole@hortonworks.com Nate Cole
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: