[SPARK-49282] Create shared interface for SparkSession.Builder

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect
• Labels: pull-request-available
• Epic Link: Unified SQL Scala Interface
• Assignee: Herman van Hövell
• Reporter: Herman van Hövell
• Created: 18/Aug/24 14:03
• Updated: 25/Sep/24 01:23
• Resolved: 25/Sep/24 01:23

Description

Create an interface for the SparkConnect.Builder: org.apache.spark.sql.api.SparkSessionBuilder.

We need to be mindful of the different methods both implementations have. One apprach would be to support the union of all methods, and log warnings (or throw errors) if things are not supported.

Issue Links

• blocks: SPARK-49700 Switch interface and implementations
• links to: GitHub Pull Request #48229