[MESOS-9428] Develop a sound plan on how to deal with disabled tests.

• Type: Task
• Status: Accepted
• Priority: Major
• Resolution: Unresolved
• Component/s: test
• Labels: disabled-test integration tests
• Story Points: 3
• Assignee: Unassigned
• Reporter: Till Toenshoff
• Created: 29/Nov/18 23:12
• Updated: 29/Apr/19 09:26

Description

We currently have disabled a bunch of tests due to their extreme flakiness. While that is a good idea for a clean start or to bridge resource starvation, it can only be a stop-gap-solution.

We should develop something that allows us to keep such tests on the radar and forces us to get them back up, bit by bit.