[KAFKA-17208] replica_scale_test.py fails for new consumer

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.8.0
• Fix Version/s: 4.0.0
• Component/s: clients, consumer, system tests
• Labels: consumer-threading-refactor
• Assignee: Kirk True
• Reporter: Kirk True
• Created: 26/Jul/24 19:13
• Updated: 10/Sep/24 11:10
• Resolved: 10/Sep/24 11:10

Description

replica_scale_test’s test_produce_consume fails when using a group_protocol of CONSUMER:

TimeoutError('replicas-consume-workload failed to finish in the expected amount of time.')
Traceback (most recent call last):
  File "/home/kafka/venv/lib/python3.8/site-packages/ducktape-0.11.1-py3.8.egg/ducktape/tests/runner_client.py", line 183, in _do_run
    data = self.run_test()
  File "/home/kafka/venv/lib/python3.8/site-packages/ducktape-0.11.1-py3.8.egg/ducktape/tests/runner_client.py", line 243, in run_test
    return self.test_context.function(self.test)
  File "/home/kafka/venv/lib/python3.8/site-packages/ducktape-0.11.1-py3.8.egg/ducktape/mark/_mark.py", line 433, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/kafka/tests/kafkatest/tests/core/replica_scale_test.py", line 116, in test_produce_consume
    consume_workload.wait_for_done(timeout_sec=600)
  File "/home/kafka/tests/kafkatest/services/trogdor/trogdor.py", line 352, in wait_for_done
    wait_until(lambda: self.done(),
  File "/home/kafka/venv/lib/python3.8/site-packages/ducktape-0.11.1-py3.8.egg/ducktape/utils/util.py", line 58, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: replicas-consume-workload failed to finish in the expected amount of time.