[SPARK-42371] Add scripts to start and stop Spark Connect server

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Connect
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 07/Feb/23 10:30
• Updated: 08/Feb/23 02:40
• Resolved: 08/Feb/23 02:40

Description

Currently, there is no proper way to start and stop the Spark Connect server. Now it requires you to start it with, for example, a Spark shell:

# For development,
./bin/spark-shell \
   --jars `ls connector/connect/target/**/spark-connect*SNAPSHOT.jar` \
  --conf spark.plugins=org.apache.spark.sql.connect.SparkConnectPlugin

# For released Spark versions
./bin/spark-shell \
  --packages org.apache.spark:spark-connect_2.12:3.4.0 \
  --conf spark.plugins=org.apache.spark.sql.connect.SparkConnectPlugin

which is awkward.

We need some dedicated scripts for it.

Issue Links

• links to: [Github] Pull Request #39928 (HyukjinKwon)
• links to: [Github] Pull Request #39928 (HyukjinKwon)