[MESOS-4302] Offer filter timeouts are ignored if the allocator is slow or backlogged.

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.24.2, 0.25.1, 0.26.1, 0.27.0
• Component/s: allocation
• Labels: mesosphere
• Target Version/s: 0.27.0
• Sprint: Mesosphere Sprint 26, Mesosphere Sprint 27
• Assignee: Alex R
• Reporter: Benjamin Mahler
• Shepherd: Benjamin Mahler
• Created: 06/Jan/16 23:42
• Updated: 26/Nov/18 12:22
• Resolved: 26/Nov/18 12:22

Description

Currently, when the allocator recovers resources from an offer, it creates a filter timeout based on time at which the call is processed.

This means that if it takes longer than the filter duration for the allocator to perform an allocation for the relevant agent, then the filter is never applied.

This leads to pathological behavior: if the framework sets a filter duration that is smaller than the wall clock time it takes for us to perform the next allocation, then the filters will have no effect. This can mean that low share frameworks may continue receiving offers that they have no intent to use, without other frameworks ever receiving these offers.

The workaround for this is for frameworks to set high filter durations, and possibly reviving offers when they need more resources, however, we should fix this issue in the allocator. (i.e. derive the timeout deadlines and expiry based on allocation times).

This seems to warrant cherry-picking into bug fix releases.

Issue Links

• is related to: MESOS-3202 Avoid role/framework offer starvation in DRF allocator.
• is related to: MESOS-7590 Make the default decline timeout configurable on the master rather than burned into the protobuf.
• is related to: MESOS-3078 Recovered resources are not re-allocated until the next allocation delay.