Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
The framework used to run system tests will soon have the capability to run tests in parallel. In our validations, we've found significant speedup with modest increase in the size of the worker cluster, as well as much better usage of the cluster resources.
A few updates to the kafka system test services and tests are needed to take full advantage of this:
1) cluster usage annotation - this provides a hint to the framework about what cluster resources to set aside for a given test, and lets the driver efficiently use the worker cluster.
2) eliminate a few canonical paths on the test driver. This is fine when tests are run serially, but in parallel, different tests end up colliding on these paths. The primary culprits here are security_config.py, and minikdc.py
Attachments
Issue Links
- links to
