Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4145

Create jobs overview and job details pages on the web UI

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: Web UI
    • Labels:
      None
    • Target Version/s:

      Description

      We should create a jobs overview and job details page on the web UI. The overview page would list all jobs in the SparkContext and would replace the current "Stages" page as the default web UI page. The job details page would provide information on the stages triggered by a particular job; it would also serve as a place to show DAG visualizations and other debugging aids.

      I still plan to keep the current "Stages" page, which lists all stages of all jobs, since it's a useful debugging aid for figuring out how resources are being consumed across all jobs in a Spark Cluster.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                joshrosen Josh Rosen
                Reporter:
                joshrosen Josh Rosen
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: