[KAFKA-14365] Extract common logic from Fetcher

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.5.0
• Component/s: clients, consumer
• Labels: consumer-threading-refactor
• Assignee: Kirk True
• Reporter: Kirk True
• Reviewer: Guozhang Wang
• Created: 07/Nov/22 18:44
• Updated: 04/Oct/23 16:50
• Resolved: 24/Mar/23 23:26

Description

The Fetcher class is used internally by the KafkaConsumer to fetch records from the brokers. There is ongoing work to create a new consumer implementation with a significantly refactored threading model. The threading refactor work requires a similarly refactored Fetcher.

This task includes refactoring Fetcher by extracting out some common logic to allow forthcoming implementations to leverage it.

Issue Links

• blocks: KAFKA-14274 Introduce FetchRequestManager to integrate fetch into new consumer threading refactor
• causes: KAFKA-14848 KafkaConsumer incorrectly passes locally-scoped deserializers to FetchConfig
• is blocked by: KAFKA-14758 Extract inner classes from Fetcher for reuse in refactoring
• is part of: KAFKA-14246 Update threading model for Consumer
• links to: GitHub Pull Request #12831
• links to: GitHub Pull Request #12832
• links to: GitHub Pull Request #12834
• links to: GitHub Pull Request #12945
• links to: GitHub Pull Request #13152
• links to: GitHub Pull Request #13293
• links to: GitHub Pull Request #13425