Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-949

Turn DAGScheduler into an Actor

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • Spark Core
    • None

    Description

      At present DAGScheduler creates a thread to process events in the eventQueue, this is a typical situation where Actor is suitable.

      So how about turn DAGScheduler into an actor, and send events as messages to it?

      The new DAGScheduler will be more efficient and the code will be shorter. Maybe JobWaiter can also be replaced with Future.

      Attachments

        Activity

          People

            liancheng liancheng
            soulmachine Frank Dai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: