Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-5814

Ambari blueprint install sets hive.tez.container.size too high in hive-site.xml.

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.6.0
    • 1.6.0
    • ambari-server
    • None

    Description

      On a cluster installed with blueprints, hive-site.xml has:

      <property>
            <name>hive.tez.container.size</name>
            <value>3000000000</value>
          </property>
      

      When you run "select count from movies_data;" the following error is seen:

      14/05/19 17:30:14 ERROR exec.Task: Failed to execute tez graph.
      java.lang.NumberFormatException: For input string: "3000000000"
      	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
      	at java.lang.Integer.parseInt(Integer.java:495)
      	at java.lang.Integer.parseInt(Integer.java:527)
      	at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1094)
      	at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:1230)
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.getContainerResource(DagUtils.java:367)
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.createVertex(DagUtils.java:565)
      	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.createVertex(DagUtils.java:955)
      	at org.apache.hadoop.hive.ql.exec.tez.TezTask.build(TezTask.java:282)
      	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:168)
      	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
      	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
      	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1504)
      	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1271)
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1089)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:912)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902)
      	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
      	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
      	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
      	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:793)
      	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
      	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            srimanth.gunturi Srimanth Gunturi Assign to me
            srimanth.gunturi Srimanth Gunturi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment