Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-3437

Improve sync throttling on a learner master

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.6.0
    • Fix Version/s: 3.6.0
    • Component/s: quorum

      Description

      As described in ZOOKEEPER-1928, a leader can become overloaded if it sends too many snapshots concurrently during sync time.  Sending too many diffs at the same time can also cause the overloading issue. 

      In this JIRA, we will:

      1. add diff sync throttling in addition to snap sync throttling
      2. extend the protection to followers that serve observers
      3. improve the counting of concurrent snap syncs/diff syncs to avoid double counting or missing counting

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jiehuangjie Jie Huang
                Reporter:
                jiehuangjie Jie Huang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 40m
                  3h 40m