[KAFKA-15163] Implement validatePositions functionality for new KafkaConsumer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.7.0
• Component/s: clients, consumer
• Labels: consumer-threading-refactor
• Assignee: Lianet Magrans
• Reporter: Lianet Magrans
• Created: 07/Jul/23 18:51
• Updated: 20/Oct/23 00:38
• Resolved: 13/Sep/23 14:52

Description

Introduce support for validating positions in the new OffsetsRequestManager. This task will include a new event for the validatePositions calls performed from the new consumer, and the logic for handling such events in the OffsetRequestManager.

The validate positions implementation will keep the same behaviour as the one in the old consumer, but adapted to the new threading model. So it is based in a VALIDATE_POSITIONS events that is submitted to the background thread, and the processed by the ApplicationEventProcessor. The processing itself is done by the OffsetRequestManager given that this will require an OFFSET_FOR_LEADER_EPOCH request. This task will introduce support for such requests in the OffsetRequestManager, responsible for offset-related requests.

Issue Links

• is a clone of: KAFKA-15115 Implement resetPositions functionality in OffsetsRequestManager
• is part of: KAFKA-14246 Update threading model for Consumer