[MESOS-6676] Always re-link with scheduler during re-registration.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.3, 1.1.1, 1.2.0
• Component/s: master
• Labels: mesosphere
• Target Version/s: 1.0.3, 1.1.1, 1.2.0
• Epic Link: Master ↔ Scheduler Partitions
• Assignee: Neil Conway
• Reporter: Neil Conway
• Shepherd: Vinod Kone
• Created: 02/Dec/16 22:16
• Updated: 16/Jan/17 16:57
• Resolved: 08/Dec/16 23:24

Description

Scenario:

1. Framework registers with master using a non-zero failover_timeout and is assigned a FrameworkID.
2. The master sees an ExitedEvent for the master->scheduler link. This could happen due to some transient network error, e.g., 1-way partition. The master sends a FrameworkErrorMessage to the framework. The master marks the framework as disconnected, but keeps the Framework* for it around in frameworks.registered.
3. The framework doesn't receive the FrameworkErrorMessage because it is dropped by the network.
4. The scheduler might receive an ExitedEvent for the scheduler -> master link, but it ignores this anyway (see MESOS-887).
5. The scheduler sees a new-master-detected event and re-registers with the master. It doesn not set the force flag. This means we follow this code path in the master, which does not relink with the scheduler.

The result is that scheduler re-registration succeds, but the master -> scheduler link is never re-established.

Issue Links

• is related to: MESOS-5180 Scheduler driver does not detect disconnection with master and reregister.
• is related to: MESOS-887 Scheduler driver should use exited() to detect disconnection with Master.