[SPARK-6942] Umbrella: UI Visualizations for Core and Dataframes

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Spark Core, SQL, Web UI
• Target Version/s: 1.5.0
• Assignee: Andrew Or
• Reporter: Patrick Wendell
• Created: 15/Apr/15 20:16
• Updated: 15/Sep/15 22:16
• Resolved: 15/Sep/15 20:35

Description

This is an umbrella issue for the assorted visualization proposals for Spark's UI. The scope will likely cover Spark 1.4 and 1.5.

Sub-Tasks

• Provide timeline view in Job UI pages: Resolved
• Graphically show the RDD DAG on the UI: Resolved
• Mechanism to associate generic operator scope with RDD's: Resolved
• Add simple per-stage visualization to the UI: Resolved
• Provide SQL tab in the Spark UI: Resolved
• Add visualization of logical and physical plans for SQL/DataFrames: Resolved
• Timeline view for Stage page: Resolved
• Make timeline more discoverable: Resolved
• Harmonize style of new UI visualizations: Resolved