[KAFKA-16405] Mismatch assignment error when running consumer rolling upgrade system tests

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.8.0
• Component/s: clients, consumer, system tests
• Labels: kip-848-client-support system-tests
• Assignee: Philip Nee
• Reporter: Philip Nee
• Reviewer: Lucas Brutschy
• Created: 22/Mar/24 16:24
• Updated: 17/Apr/24 18:23
• Resolved: 17/Apr/24 18:23

Description

relevant to https://github.com/apache/kafka/pull/15578

 

We are seeing:

================================================================================
SESSION REPORT (ALL TESTS)
ducktape version: 0.11.4
session_id:       2024-03-21--001
run time:         3 minutes 24.632 seconds
tests run:        7
passed:           5
flaky:            0
failed:           2
ignored:          0
================================================================================
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=COMBINED_KRAFT.use_new_coordinator=True.group_protocol=classic
status:     PASS
run time:   24.599 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=COMBINED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status:     FAIL
run time:   26.638 seconds


    AssertionError("Mismatched assignment: {frozenset(), frozenset({TopicPartition(topic='test_topic', partition=3), TopicPartition(topic='test_topic', partition=0), TopicPartition(topic='test_topic', partition=1), TopicPartition(topic='test_topic', partition=2)})}")
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 186, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 246, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line 433, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/opt/kafka-dev/tests/kafkatest/tests/client/consumer_rolling_upgrade_test.py", line 77, in rolling_update_test
    self._verify_range_assignment(consumer)
  File "/opt/kafka-dev/tests/kafkatest/tests/client/consumer_rolling_upgrade_test.py", line 38, in _verify_range_assignment
    assert assignment == set([
AssertionError: Mismatched assignment: {frozenset(), frozenset({TopicPartition(topic='test_topic', partition=3), TopicPartition(topic='test_topic', partition=0), TopicPartition(topic='test_topic', partition=1), TopicPartition(topic='test_topic', partition=2)})}

--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status:     PASS
run time:   29.815 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True
status:     PASS
run time:   29.766 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status:     PASS
run time:   30.086 seconds
--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status:     FAIL
run time:   35.965 seconds


    AssertionError("Mismatched assignment: {frozenset(), frozenset({TopicPartition(topic='test_topic', partition=3), TopicPartition(topic='test_topic', partition=0), TopicPartition(topic='test_topic', partition=1), TopicPartition(topic='test_topic', partition=2)})}")
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 186, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line 246, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line 433, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/opt/kafka-dev/tests/kafkatest/tests/client/consumer_rolling_upgrade_test.py", line 77, in rolling_update_test
    self._verify_range_assignment(consumer)
  File "/opt/kafka-dev/tests/kafkatest/tests/client/consumer_rolling_upgrade_test.py", line 38, in _verify_range_assignment
    assert assignment == set([
AssertionError: Mismatched assignment: {frozenset(), frozenset({TopicPartition(topic='test_topic', partition=3), TopicPartition(topic='test_topic', partition=0), TopicPartition(topic='test_topic', partition=1), TopicPartition(topic='test_topic', partition=2)})}

--------------------------------------------------------------------------------
test_id:    kafkatest.tests.client.consumer_rolling_upgrade_test.ConsumerRollingUpgradeTest.rolling_update_test.metadata_quorum=ZK.use_new_coordinator=False
status:     PASS
run time:   27.644 seconds
--------------------------------------------------------------------------------