[KAFKA-16565] IncrementalAssignmentConsumerEventHandler throws error when attempting to remove a partition that isn't assigned

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.8.0
• Fix Version/s: 3.8.0
• Component/s: clients, consumer, system tests
• Labels: consumer-threading-refactor kip-848-client-support system-tests
• Assignee: Kirk True
• Reporter: Kirk True
• Reviewer: Lucas Brutschy
• Created: 16/Apr/24 17:35
• Updated: 26/Apr/24 19:17
• Resolved: 26/Apr/24 19:17

Description

In verifiable_consumer.py, the IncrementalAssignmentConsumerEventHandler contains this logic:

def handle_partitions_revoked(self, event):
    self.revoked_count += 1
    self.state = ConsumerState.Rebalancing
    self.position = {}
    for topic_partition in event["partitions"]:
        topic = topic_partition["topic"]
        partition = topic_partition["partition"]
        self.assignment.remove(TopicPartition(topic, partition))

If the self.assignment.remove() call is passed a TopicPartition that isn't in the list, a generic Python list error is thrown. For now, we should first check that the TopicPartition is in the list with an assert that provides better information .

Issue Links

• links to: GitHub Pull Request #15737