[SPARK-8862] Add a web UI page that visualizes physical plans (SparkPlan)

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Assignee: Shixiong Zhu
• Reporter: Reynold Xin
• Created: 07/Jul/15 02:02
• Updated: 15/Sep/15 20:34
• Resolved: 05/Aug/15 08:52

Description

We currently have the ability to visualize part of the query plan using the Spark DAG viz. However, that does NOT work for one of the most important operators: broadcast join. The reason is that broadcast join launches multiple Spark jobs.

Issue Links

• duplicates: SPARK-6945 Provide SQL tab in the Spark UI
• duplicates: SPARK-6946 Add visualization of logical and physical plans for SQL/DataFrames
• links to: [Github] Pull Request #7774 (zsxwing)
• links to: [Github] Pull Request #7962 (zsxwing)