[ZOOKEEPER-3437] Improve sync throttling on a learner master

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.6.0
• Fix Version/s: 3.6.0
• Component/s: quorum
• Labels: pull-request-available
• Assignee: Jie Huang
• Reporter: Jie Huang
• Created: 20/Jun/19 19:19
• Updated: 26/Jul/19 03:51
• Resolved: 25/Jul/19 19:43

Description

As described in ZOOKEEPER-1928, a leader can become overloaded if it sends too many snapshots concurrently during sync time.  Sending too many diffs at the same time can also cause the overloading issue. 

In this JIRA, we will:

1. add diff sync throttling in addition to snap sync throttling
2. extend the protection to followers that serve observers
3. improve the counting of concurrent snap syncs/diff syncs to avoid double counting or missing counting

Issue Links

• links to: GitHub Pull Request #995