[SPARK-44206] Dataset.selectExpr scope Session.active

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.2, 3.5.0
• Component/s: SQL
• Assignee: Mingliang Zhu
• Reporter: Mingliang Zhu
• Created: 27/Jun/23 08:49
• Updated: 28/Jun/23 03:07
• Resolved: 28/Jun/23 03:07

Description

//代码占位符
val clone = spark.cloneSession()
clone.conf.set("spark.sql.legacy.interval.enabled", "true")
clone.sql("select '2023-01-01'+ INTERVAL 1 YEAR as b").show()
clone.sql("select '2023-01-01' as a").selectExpr("a + INTERVAL 1 YEAR as b").show() 

The first one can be executed successfully, but the second one cannot be executed successfully.

Because selectExpr and sql use different sparkSession conf.