[SPARK-31946] Failed to register SIGPWR handler on MacOS

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0
• Component/s: Spark Core

Environment

macOS 10.14.6

• Assignee: wuyi
• Reporter: wuyi
• Created: 10/Jun/20 01:58
• Updated: 31/Dec/20 21:13
• Resolved: 31/Dec/20 21:13

Description

 

20/06/09 22:54:54 WARN SignalUtils: Failed to register SIGPWR handler - disabling decommission feature.
java.lang.IllegalArgumentException: Unknown signal: PWR
	at sun.misc.Signal.<init>(Signal.java:143)
	at org.apache.spark.util.SignalUtils$.$anonfun$register$1(SignalUtils.scala:83)
	at scala.collection.mutable.HashMap.getOrElseUpdate(HashMap.scala:86)
	at org.apache.spark.util.SignalUtils$.register(SignalUtils.scala:81)
	at org.apache.spark.executor.CoarseGrainedExecutorBackend.onStart(CoarseGrainedExecutorBackend.scala:86)
	at org.apache.spark.rpc.netty.Inbox.$anonfun$process$1(Inbox.scala:120)
	at org.apache.spark.rpc.netty.Inbox.safelyCall(Inbox.scala:203)
	at org.apache.spark.rpc.netty.Inbox.process(Inbox.scala:100)
	at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:75)
	at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Seem like MacOS is POSIX compliant. But SIGPWR is not specified in the POSIX specification. See https://en.wikipedia.org/wiki/Signal_(IPC)#SIGPWR

 

Issue Links

• links to: [Github] Pull Request #30968 (Ngone51)