Details
-
Task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
This is an umbrella JIRA that proposes a new REEF application Vortex, which aims to ease programming of low-priority job that run on volatile(preemptable) resources.
The motivation is that today’s datacenters are often under-utilized due to high-priority tenants that need to dynamically adjust resource usage depending on load fluctuations.
Our approach to this problem is to provide a runtime for low-priority jobs to effectively cope with non-cooperative(thus low-latency) preemptions with the following goals:
- Allow high-priority jobs to reclaim resources quickly
- Allow low-priority jobs to efficiently utilize volatile resources
Attachments
1.
|
Simple duplicate Vortex Tasklet launch |
|
Open | John Yang |
2.
|
Distinguish different types of FailedEvaluator in Vortex |
|
Open | John Yang |
3.
|
Basic Vortex profiling |
|
Open | John Yang |
4.
|
Extend configuration options for Vortex resources |
|
Open | Unassigned |
5.
|
VortexRequestor creates too many threads |
|
Open | John Yang |
6.
|
Higher-level Vortex API |
|
Open | Unassigned |