Major Description
- Scenario 1:
Have a 3 master setup.
Have some nodes heart beating across the nodes.
Kill one of the masters.
Nodes that once heartbeated with dead master move to other masters.
Attempt to bring dead master back up.
- Revived master eventually get into exception loop that never stops.
- Scenario 2:
Have a 3 master setup.
Have some nodes heart beating across the nodes.
Kill one of the masters.
Nodes that once heartbeated with dead master move to other masters.
Kill a second master.
All nodes now heartbeat with single remaining master.
Bring up a dead master.
It rejoins.
Bring up other dead master.
It rejoins.
(All heart beats remain with the master that initally survived)