[STORM-893] Resource Aware Scheduling

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: storm-core
• Assignee: Boyang Jerry Peng
• Reporter: Robert Joseph Evans
• Created: 19/Jun/15 01:34
• Updated: 29/Oct/15 20:27

Description

At Yahoo we have been working on resource aware scheduling in storm, based off of some work done in academia. This rollup ticket is to track the complete project. With several sub tasks. Some that are already done and need to be pushed back, and others that we have not started on yet.

Issue Links

• incorporates: STORM-895 Explore different Resource Aware scheduling strategies
• incorporates: STORM-896 Make Resource Aware strategy configurable per topology
• incorporates: STORM-897 Add Multi-tenant scheduler as a resource aware strategy
• incorporates: STORM-900 Provide Metrics Feedback API to Resource Aware Scheduler
• incorporates: STORM-894 Basic Resource Aware Scheduling
• incorporates: STORM-898 Add priorities and per user resource guarantees to Resource Aware Scheduler
• incorporates: STORM-1146 Enforced resource isolation for Resource Aware Scheduler
• is related to: STORM-1093 Launching Workers with resources specified in resource-aware schedulers