Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7932

Scheduler delay shown in event timeline is incorrect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0
    • Web UI
    • None

    Description

      In StagePage.scala, we round down to the nearest percent when computing the proportion of a task's time spend in each phase of execution. Scheduler delay is computed by taking 100 - sum(all other proportions), which means that a few extra percent may go into the scheduler delay. As a result, scheduler delay can appear larger in the visualization than it actually is.

      cc shivaram

      Attachments

        Activity

          People

            kayousterhout Kay Ousterhout
            kayousterhout Kay Ousterhout
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: