[KAFKA-16133] Commits during reconciliation always time out

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Fix Version/s: 3.7.0
• Component/s: clients, consumer
• Labels: consumer-threading-refactor reconciliation timeout
• Assignee: Lianet Magrans
• Reporter: Lucas Brutschy
• Created: 15/Jan/24 12:57
• Updated: 19/Feb/24 10:05
• Resolved: 06/Feb/24 17:44

Description

This only affects the AsyncKafkaConsumer, which is in Preview in 3.7.

In MembershipManagerImpl there is a confusion between timeouts and deadlines. https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/MembershipManagerImpl.java#L836C38-L836C38

This causes all autocommits during reconciliation to immediately time out.

Issue Links

• links to: GitHub Pull Request #15194
• links to: GitHub Pull Request #15195