[KAFKA-8806] Kafka.poll spends significant amount of time in KafkaConsumer.updateAssignmentMetadataIfNeeded

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.0
• Assignee: David Arthur
• Reporter: Xavier Léauté
• Created: 14/Aug/19 23:02
• Updated: 21/Aug/20 14:26

Description

Comparing the performance profile of 2.2.0 and 2.3.0, we are seeing significant performance differences in the KafkaConumer.updateAssignmentMetadataIfNeeded() method.

The call to KafkaConsumer.updateAssignmentMetadataIfNeeded() now represents roughly 25% of CPU time spent in KafkaConsumer.poll(), when before it only represented less than 5%.

Most of the extra time appears to be spent in KafkaConsumer.validateOffsetsIfNeeded(), which did not show up in previous profiles.

Issue Links

• links to: GitHub Pull Request #7222