[SPARK-44410] SparkSession.builder.create doesn't set active session

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Connect
• Assignee: Alice Sayutina
• Reporter: Alice Sayutina
• Created: 13/Jul/23 12:37
• Updated: 16/Jul/23 07:31
• Resolved: 16/Jul/23 07:31

Description

ML and other uses rely on _active_spark_session to find spark session.

Sessions created using getOrCreate method set this variable, but sessions created with create don't.

Issue Links

• links to: [Github] Pull Request #41987 (cdkrot)