[SPARK-45147] Remove System.setSecurityManager usage

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 13/Sep/23 07:11
• Updated: 13/Sep/23 09:03
• Resolved: 13/Sep/23 09:03

Description

$ java -version
openjdk version "21-ea" 2023-09-19
OpenJDK Runtime Environment (build 21-ea+32-2482)
OpenJDK 64-Bit Server VM (build 21-ea+32-2482, mixed mode, sharing)
max spark-3.5.0-bin-hadoop3:$ bin/spark-sql --help
...
CLI options:
Exception in thread "main" java.lang.UnsupportedOperationException: The Security Manager is deprecated and will be removed in a future release
	at java.base/java.lang.System.setSecurityManager(System.java:429)
	at org.apache.spark.deploy.SparkSubmitArguments.getSqlShellOptions(SparkSubmitArguments.scala:623)
	at org.apache.spark.deploy.SparkSubmitArguments.$anonfun$printUsageAndExit$6(SparkSubmitArguments.scala:593)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.logInfo(SparkSubmit.scala:1112)
	at org.apache.spark.deploy.SparkSubmit$$anon$2$$anon$3.logInfo(SparkSubmit.scala:1104)
	at org.apache.spark.deploy.SparkSubmitArguments.printUsageAndExit(SparkSubmitArguments.scala:593)
	at org.apache.spark.deploy.SparkSubmitArguments.handle(SparkSubmitArguments.scala:448)
	at org.apache.spark.launcher.SparkSubmitOptionParser.parse(SparkSubmitOptionParser.java:174)
	at org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:111)
	at org.apache.spark.deploy.SparkSubmit$$anon$2$$anon$3.<init>(SparkSubmit.scala:1103)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.parseArguments(SparkSubmit.scala:1103)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1120)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1129)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Issue Links

• links to: GitHub Pull Request #42901