Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-21637

Maintain default hive.execution.engine as MR for IOP upgrade

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.5.2
    • Fix Version/s: 2.5.2
    • Component/s: ambari-upgrade
    • Labels:
      None

      Description

      During IOP upgrade to HDP hive.execution.engine is being set to tez which prevents hive cli from coming with below error

      Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://nat-r6-macs-webhcat-4.openstacklocal:8020/tmp/hive/hrt_qa/_tez_session_dir/af63f8a7-3333-4252-bf22-4fffddae4680/hbase-client.jar. Failing because I am unlikely to write too.
      	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:560)
      	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
      	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
      Caused by: java.io.IOException: Previous writer likely failed to write hdfs://nat-r6-macs-webhcat-4.openstacklocal:8020/tmp/hive/hrt_qa/_tez_session_dir/af63f8a7-3333-4252-bf22-4fffddae4680/hbase-client.jar. Failing because I am unlikely to write too.
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:1002)
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:882)
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:809)
      	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:258)
      	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:157)
      	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
      	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:557)
      	... 8 more
      

        Attachments

        1. AMBARI-21637.patch
          4 kB
          Attila Doroszlai

          Issue Links

            Activity

              People

              • Assignee:
                adoroszlai Attila Doroszlai
                Reporter:
                asreekumar Aswathy Chellammal Sreekumar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: