[SPARK-12892] Support plugging in Spark scheduler - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

Delete

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: None
Fix Version/s: None
Component/s: Spark Core
Labels:
None

Description

Currently the only supported cluster schedulers are standalone, Mesos, Yarn and Simr. However if users like to build a new one it must be merged back into main, and might not be desirable for Spark and hard to iterate.
Instead, we should make a plugin architecture possible so that when users like to integrate with new scheduler it can plugged in via configuration and runtime loading instead.