[KAFKA-16231] Update consumer_test.py to support KIP-848’s group protocol config

• Type: Test
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Fix Version/s: 3.8.0
• Component/s: clients, consumer, system tests
• Labels: kip-848-client-support system-tests
• Assignee: Kirk True
• Reporter: Kirk True
• Reviewer: Lucas Brutschy
• Created: 06/Feb/24 19:32
• Updated: 15/Mar/24 21:48
• Resolved: 15/Mar/24 21:48

Description

This task is to update consumer_test.py to support the group.protocol configuration introduced in KIP-848 by adding an optional group_protocol argument to the tests and matrixes.

For example, here's how it would look to add the new group_protocol parameter to the parameterized tests:

    @cluster(num_nodes=6)
    @matrix(
        assignment_strategy=["org.apache.kafka.clients.consumer.RangeAssignor",
                             "org.apache.kafka.clients.consumer.RoundRobinAssignor",
                             "org.apache.kafka.clients.consumer.StickyAssignor"], 
        metadata_quorum=[quorum.zk, quorum.isolated_kraft],
        use_new_coordinator=[False]
    )
    @matrix(
        metadata_quorum=[quorum.isolated_kraft],
        use_new_coordinator=[True],
        group_protocol=["classic", "consumer"]
    )
    def test_the_consumer(self, assignment_strategy, metadata_quorum=quorum.zk, use_new_coordinator=False, group_protocol="classic"):
        consumer = self.setup_consumer("my_topic", group_protocol=group_protocol)

The group_protocol parameter will default to classic.

Note: we only test the new group protocol setting when use_new_coordinator is True, as that is the only supported mode.

Issue Links

• is related to: KAFKA-16037 Update VerifiableConsumer to support KIP-848’s group protocol config
• is related to: KAFKA-16230 Update verifiable_consumer.py to support KIP-848’s group protocol config
• relates to: KAFKA-15691 Update system tests to use AsyncKafkaConsumer
• links to: GitHub Pull Request #15330