[ZOOKEEPER-3180] Add response cache to improve the throughput of read heavy traffic

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.6.0
• Component/s: server
• Labels: pull-request-available
• Assignee: Brian Nixon
• Reporter: Fangmin Lv
• Created: 19/Oct/18 21:54
• Updated: 26/Sep/19 06:26
• Resolved: 14/Jan/19 18:39

Description

On read heavy use case with large response data size, the serialization of response takes time and added overhead to the GC.

Add response cache helps improving the throughput we can support, which also reduces the latency in general.

This Jira is going to implement a LRU cache for the response, which shows some performance gain on some of our production ensembles.

Issue Links

• is related to: ZOOKEEPER-3560 Add response cache to serve get children (2) requests.
• links to: GitHub Pull Request #684
• links to: GitHub Pull Request #684