[STORM-894] Basic Resource Aware Scheduling

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: storm-core
• Assignee: Boyang Jerry Peng
• Reporter: Robert Joseph Evans
• Created: 19/Jun/15 01:37
• Updated: 09/Oct/15 14:55
• Resolved: 09/Oct/15 14:55

Description

At Yahoo we have the beginnings of a basic implementation. It includes APIs for setting resources suggestions on a per bolt/spout instance basis, ways for the supervisor to report the resources it has, and a pluggable scheduling strategy with a simple implementation.

There is still a lot of work to do, but we though pushing it to open source early rather then later would allow more people to work on it and help produce a better result.

Issue Links

• blocks: STORM-895 Explore different Resource Aware scheduling strategies
• blocks: STORM-896 Make Resource Aware strategy configurable per topology
• blocks: STORM-900 Provide Metrics Feedback API to Resource Aware Scheduler
• blocks: STORM-898 Add priorities and per user resource guarantees to Resource Aware Scheduler
• is part of: STORM-893 Resource Aware Scheduling