Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
None
-
None
-
None
Description
Run SparkPi example with jdk8 successfully, but some spark cluster log below warnig at the end.
16/03/08 09:27:46 WARN AbstractConnector:
java.io.IOException: No such file or directory
at sun.nio.ch.NativeThread.signal(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.implCloseSelectableChannel(ServerSocketChannelImpl.java:292)
at java.nio.channels.spi.AbstractSelectableChannel.implCloseChannel(AbstractSelectableChannel.java:234)
at java.nio.channels.spi.AbstractInterruptibleChannel.close(AbstractInterruptibleChannel.java:115)
at org.sparkproject.jetty.server.nio.SelectChannelConnector.close(SelectChannelConnector.java:126)
at org.sparkproject.jetty.server.AbstractConnector.doStop(AbstractConnector.java:347)
at org.sparkproject.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.sparkproject.jetty.server.Server.doStop(Server.java:340)
at org.sparkproject.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.apache.spark.ui.WebUI.stop(WebUI.scala:153)
at org.apache.spark.ui.SparkUI.stop(SparkUI.scala:100)
at org.apache.spark.SparkContext$$anonfun$stop$2$$anonfun$apply$mcV$sp$2.apply(SparkContext.scala:1737)
at org.apache.spark.SparkContext$$anonfun$stop$2$$anonfun$apply$mcV$sp$2.apply(SparkContext.scala:1737)
at scala.Option.foreach(Option.scala:236)
at org.apache.spark.SparkContext$$anonfun$stop$2.apply$mcV$sp(SparkContext.scala:1737)
at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1200)
at org.apache.spark.SparkContext.stop(SparkContext.scala:1736)
at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:38)
at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:762)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:183)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:208)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:123)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Attachments
Issue Links
- duplicates
-
SPARK-30385 WebUI occasionally throw IOException on stop()
- Resolved