Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-14400

Spark server restart failed (java.lang.NumberFormatException) causing express upgrade to fail.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: None
    • Labels:
      None

      Description

      While creating cluster on suse, Spark service is not able to start. Restart of
      same service is also not working.

      5/12/16 08:54:38 INFO SparkEnv: Registering OutputCommitCoordinator
      15/12/16 08:54:38 INFO Server: jetty-8.y.z-SNAPSHOT
      15/12/16 08:54:38 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
      15/12/16 08:54:38 INFO Utils: Successfully started service 'SparkUI' on port 4040.
      15/12/16 08:54:38 INFO SparkUI: Started SparkUI at http://172.22.107.190:4040
      15/12/16 08:54:38 INFO Executor: Starting executor ID driver on host localhost
      15/12/16 08:54:38 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 42892.
      15/12/16 08:54:38 INFO NettyBlockTransferService: Server created on 42892
      15/12/16 08:54:38 INFO BlockManagerMaster: Trying to register BlockManager
      15/12/16 08:54:38 INFO BlockManagerMasterEndpoint: Registering block manager localhost:42892 with 265.1 MB RAM, BlockManagerId(driver, localhost, 42892)
      15/12/16 08:54:38 INFO BlockManagerMaster: Registered BlockManager
      15/12/16 08:54:40 INFO HiveContext: Initializing execution hive, version 0.13.1
      Exception in thread "main" java.lang.RuntimeException: java.lang.NumberFormatException: For input string: "5s"
      at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:346)
      at org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:117)
      at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:165)
      at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:163)
      at org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:170)
      at org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.init(SparkSQLEnv.scala:53)
      at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:75)
      at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:497)
      at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665)
      at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170)
      at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193)
      at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112)
      at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      Caused by: java.lang.NumberFormatException: For input string: "5s"
      at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
      at java.lang.Integer.parseInt(Integer.java:580)
      at java.lang.Integer.parseInt(Integer.java:615)
      at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1258)
      at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:1211)
      at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:1220)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:58)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:72)
      at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2453)
      at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2465)
      at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:340)
      ... 16 more
      15/12/16 08:54:40 INFO SparkContext: Invoking stop() from shutdown hook
      15/12/16 08:54:40 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler

      {/metrics/json,null}

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aonishuk Andrew Onischuk
                Reporter:
                aonishuk Andrew Onischuk
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: