[MESOS-3572] Faster catchup protocol for "learned" replicated log entries

• Type: Improvement
• Status: Accepted
• Priority: Major
• Resolution: Unresolved
• Component/s: replicated log
• Labels: Mesosphere
• Assignee: Unassigned
• Reporter: Neil Conway
• Created: 01/Oct/15 22:28
• Updated: 26/Nov/18 13:36

Description

Right now, the catchup protocol does a full Paxos round for every log entry missing from a recovering replica. This should be unnecessary for "learned" log entries, because there is no uncertainty about the status of such log entries. We'll probably only need to do a full Paxos round for entries near the tail of the log.

To motivate changing this, it would be good to first measure the performance of the catchup protocol to understand if/when performance improvements would be useful. There's also MESOS-770, which mentions the idea of doing catchup in parallel.

Issue Links

• is related to: MESOS-770 Rate control and randomization of Replicated Log catching-up