[KAFKA-8164] Improve test passing rate by rerunning flaky tests

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.6.0
• Assignee: Viktor Somogyi-Vass
• Reporter: Viktor Somogyi-Vass
• Created: 27/Mar/19 14:12
• Updated: 07/Jul/20 14:59
• Resolved: 06/Feb/20 00:45

Description

Failing flaky tests are often a problem:

• pull requests need to be rerun to achieve a green build
• rerunning the whole build for a PR is resource and time consuming
• green build give high confidence when releasing (and well, generally too) but flaky tests often erode this and annoying for the developers

The aim of this JIRA is to provide an improvement which automatically retries any tests that are failed for the first run.

Issue Links

• links to: GitHub Pull Request #6506
• links to: GitHub Pull Request #8019