[SPARK-1715] Ensure actor is self-contained in DAGScheduler

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: Scheduler, Spark Core
• Assignee: Nan Zhu
• Reporter: Nan Zhu
• Created: 04/May/14 22:47
• Updated: 17/May/20 17:48
• Resolved: 15/May/15 13:47

Description

Though the current supervisor-child structure works fine for fault-tolerance, it violates the basic rule that the actor is better to be self-contained

We should forward the message from supervisor to the child actor, so that we can eliminate the hard-coded timeout threshold for starting the DAGScheduler and provide more convenient interface for future development like parallel DAGScheduler, or new changes to the DAGScheduler

Issue Links

• links to: [Github] Pull Request #637 (CodingCat)