[AMBARI-14400] Spark server restart failed (java.lang.NumberFormatException) causing express upgrade to fail.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Assignee: Andrew Onischuk
• Reporter: Andrew Onischuk
• Created: 16/Dec/15 16:38
• Updated: 16/Dec/15 23:25
• Resolved: 16/Dec/15 18:11

Description

While creating cluster on suse, Spark service is not able to start. Restart of
same service is also not working.

5/12/16 08:54:38 INFO SparkEnv: Registering OutputCommitCoordinator
15/12/16 08:54:38 INFO Server: jetty-8.y.z-SNAPSHOT
15/12/16 08:54:38 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
15/12/16 08:54:38 INFO Utils: Successfully started service 'SparkUI' on port 4040.
15/12/16 08:54:38 INFO SparkUI: Started SparkUI at http://172.22.107.190:4040
15/12/16 08:54:38 INFO Executor: Starting executor ID driver on host localhost
15/12/16 08:54:38 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 42892.
15/12/16 08:54:38 INFO NettyBlockTransferService: Server created on 42892
15/12/16 08:54:38 INFO BlockManagerMaster: Trying to register BlockManager
15/12/16 08:54:38 INFO BlockManagerMasterEndpoint: Registering block manager localhost:42892 with 265.1 MB RAM, BlockManagerId(driver, localhost, 42892)
15/12/16 08:54:38 INFO BlockManagerMaster: Registered BlockManager
15/12/16 08:54:40 INFO HiveContext: Initializing execution hive, version 0.13.1
Exception in thread "main" java.lang.RuntimeException: java.lang.NumberFormatException: For input string: "5s"
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:346)
at org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:117)
at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:165)
at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:163)
at org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:170)
at org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.init(SparkSQLEnv.scala:53)
at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:75)
at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NumberFormatException: For input string: "5s"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:580)
at java.lang.Integer.parseInt(Integer.java:615)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1258)
at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:1211)
at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:1220)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:58)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:72)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2453)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2465)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:340)
... 16 more
15/12/16 08:54:40 INFO SparkContext: Invoking stop() from shutdown hook
15/12/16 08:54:40 INFO ContextHandler: stopped o.s.j.s.ServletContextHandler

{/metrics/json,null}

Issue Links

• links to: ReviewBoard