Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10930

History "Stages" page "duration" can be confusing

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.5.1
    • Fix Version/s: 1.6.0
    • Component/s: Web UI
    • Labels:
      None
    • Target Version/s:

      Description

      The spark history server, "stages" page shows each stage submitted time and the duration. The duration can be confusing since the time it actually starts tasks might be much later then its submitted if its waiting on previous stages. This makes it hard to figure out which stages were really slow without clicking into each stage.

      It would be nice to perhaps have a first task launched time or processing time spent in each stage to easily be able to find the slow stages.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dagit Derek Dagit
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: