[KAFKA-17183] New consumer system tests pass for subset of tests, but fail if running all tests

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Cannot Reproduce
• Affects Version/s: 3.8.0
• Fix Version/s: 4.0.0
• Component/s: clients, consumer, system tests
• Labels: consumer-threading-refactor system-tests
• Assignee: Kirk True
• Reporter: Kirk True
• Created: 22/Jul/24 20:54
• Updated: 09/Aug/24 18:36
• Resolved: 09/Aug/24 18:36

Description

In 3.8, many of the system tests were updated to exercise both the old consumer and the new consumer. For quicker feedback, I have been creating a YAML-based test suite for just the subset of tests that were updated. When running the system tests in the subset, I am consistently seeing 100% pass rate. Recently I started running the entire test suite, and are now seeing many failures.

The cause is as yet unknown, but adding this here as a task to fix whatever is causing this behavior.

Issue Links

• is a parent of: KAFKA-17219 Adjust system test framework for new protocol consumer