[MESOS-4303] Support resources re-shuffle when new framework registered

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: master
• Epic Name: reclaim
• Assignee: Unassigned
• Reporter: Klaus Ma
• Created: 07/Jan/16 00:46
• Updated: 09/Jul/16 10:48

Description

Currently, if one famework launched tasks in all resources, the other framework has to wait those tasks completed to get deserved resources. That's un-fair to the new framework, there're several EPICs on such case but still can not resolve it:

• Quota: balance resouces based on un-allocated resources; the used resources can not be reclaim back when new framework registered
• Optimistic Offer Phase 1 (oversubscription of reservation): the un-used reserved resources can be used by the new framework; but still can not reclaim un-reserved resources back.
• Optimistic Offer Phase 2: in phase 2, all resources are offered to all framework; besides resources conflict, it also need to re-shuffle resources if one framework over occupied.

The target of this EPIC is to
1. Enhance DRF to identify which resources should be reclaim
2. Define the protocol between Mesos & Framework to reclaim resources gracefully

To keep the compatibility, this feature is controlled by master paramenter, e.g. --enable-reclaim.

Issue Links

• is blocked by: MESOS-4811 Reusable/Cacheable Offer
• is blocked by: MESOS-4553 Manage offers in allocator.