[SPARK-31325] Control a plan explain mode in the events of SQL listeners via SQLConf

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SQL, Web UI
• Assignee: Takeshi Yamamuro
• Reporter: Takeshi Yamamuro
• Created: 02/Apr/20 04:38
• Updated: 06/May/21 06:27
• Resolved: 03/Apr/20 04:10

Description

This proposes to add a new SQL config for controlling a plan explain mode in the events of (e.g., `SparkListenerSQLExecutionStart` and `SparkListenerSQLAdaptiveExecutionUpdate`) SQL listeners.

In the current master, the output of `QueryExecution.toString` (this is equivalent to the "extended" explain mode) is stored in these events. I think it is useful to control the content via SQLConf.

Issue Links

• links to: GitHub Pull Request #28097