Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.1.0
-
None
Description
I've just tried to test something on standalone mode but the application fails.
Environment:
- MacOS Catalina 10.15.3 (19D76)
- Scala 2.12.10
- Java 1.8.0_241-b07
Steps to reproduce:
- Compile Spark (mvn -DskipTests clean install -Dskip)
- ./sbin/start-master.sh
- ./sbin/start-slave.sh spark://host:7077
- submit an empty application
Error:
20/03/02 14:25:44 INFO SignalUtils: Registering signal handler for PWR 20/03/02 14:25:44 WARN SignalUtils: Failed to register signal handler for PWR java.lang.IllegalArgumentException: Unknown signal: PWR at sun.misc.Signal.<init>(Signal.java:143) at org.apache.spark.util.SignalUtils$.$anonfun$register$1(SignalUtils.scala:64) at scala.collection.mutable.HashMap.getOrElseUpdate(HashMap.scala:86) at org.apache.spark.util.SignalUtils$.register(SignalUtils.scala:62) at org.apache.spark.executor.CoarseGrainedExecutorBackend.onStart(CoarseGrainedExecutorBackend.scala:85) at org.apache.spark.rpc.netty.Inbox.$anonfun$process$1(Inbox.scala:120) at org.apache.spark.rpc.netty.Inbox.safelyCall(Inbox.scala:203) at org.apache.spark.rpc.netty.Inbox.process(Inbox.scala:100) at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:75) at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Attachments
Issue Links
- is caused by
-
SPARK-20628 Keep track of nodes which are going to be shut down & avoid scheduling new tasks
- Resolved
- links to