[KAFKA-9039] Optimize replica fetching CPU utilization with large number of partitions

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.5.0
• Component/s: core
• Assignee: Lucas Bradstreet
• Reporter: Guozhang Wang
• Created: 14/Oct/19 17:36
• Updated: 16/Oct/19 16:50
• Resolved: 16/Oct/19 16:50

Description

Our current follower replica fetching logic has huge CPU cost with num.partitions to fetch from, and it scales non-linearly as well. There are a bunch of optimizations we can consider to try to reduce its cost and hopefully make it to be linear against the num.partitions.

Issue Links

• links to: GitHub Pull Request #7443