Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19793

Use clock.getTimeMillis when mark task as finished in TaskSetManager.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.1.0
    • 2.2.0
    • Scheduler, Spark Core
    • None

    Description

      TaskSetManager is now using System.getCurrentTimeMillis when mark task as finished in handleSuccessfulTask and handleFailedTask. Thus developer cannot set the tasks finishing time in unit test. When handleSuccessfulTask, task's duration = System.getCurrentTimeMillis - launchTime(which can be set by clock), the result is not correct.

      Attachments

        Activity

          People

            jinxing6042@126.com Jin Xing
            jinxing6042@126.com Jin Xing
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: