[KAFKA-14965] Introduce OffsetsRequestManager to integrate ListOffsets requests into new consumer threading refactor

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.7.0
• Component/s: clients, consumer
• Labels: consumer-threading-refactor
• Assignee: Lianet Magrans
• Reporter: Lianet Magrans
• Created: 03/May/23 20:51
• Updated: 6 days ago 10:05
• Resolved: 01/Sep/23 20:58

Description

This task introduces new functionality for handling ListOffsets requests for the new consumer implementation, as part for the ongoing work for the consumer threading model refactor.

This task introduces a new class named {{OffsetsRequestManager, }}responsible of :

• building ListOffsets requests
• process its responses

Consumer API functionality that requires ListOffsets requests are implemented using this manager: beginningOffsets, endOffsets and offsetsForTimes.

These consumer API functions will generate a ListOffsetsApplicationEvent with parameters. This event is then handled by the OffsetsRequestManager, who will build the ListOffsets request and process its responses, to provide a result back to the API via the ListOffsetsApplicationEvent completion.  

Issue Links

• is part of: KAFKA-14246 Update threading model for Consumer
• is required by: KAFKA-15081 Implement new consumer offsetsForTimes
• relates to: KAFKA-18469 AsyncConsumer fails to retry ListOffsetRequest on ReplicaNotAvailable error without metadata update
• links to: GitHub Pull Request #14308