[SPARK-39902] Add Scan details to spark plan scan node in SparkUI

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL, Web UI
• Assignee: Sumeet
• Reporter: Sumeet
• Created: 28/Jul/22 01:06
• Updated: 02/Aug/22 04:07
• Resolved: 02/Aug/22 01:41

Description

Hi,

For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" as opposed to "Scan <fileformat>".

Add a method "String name()" to the Scan interface, that "BatchScanExec" can invoke to set the node name the plan. This nodeName will be eventually used by "SparkPlanGraphNode" to display it in the header of the UI node.

 

DSv1

 

DSv2

Issue Links

• links to: [Github] Pull Request #37325 (sumeetgajjar)