[SPARK-48401] Spark Connect Go Session Type cannot be used in complex code

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.5.1
• Component/s: Connect

Language

Go

• Assignee: Unassigned
• Reporter: David Sisson
• Created: 23/May/24 07:41
• Updated: 23/May/24 07:41

Description

The return type of a Spark Session builder is an unexported type.  This means that code cannot pass around a sql.sparkSession to perform more complex tasks (for instance, a routine that sets up a set of temporary views for later processing on).

 
spark, err := sql.SparkSession.Builder.Remote(*remote).Build()