[HBASE-25888] Backup tests are categorically flakey

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1
• Component/s: backup&restore, test
• Hadoop Flags: Reviewed
• Assignee: Mallikarjun
• Reporter: Nick Dimiduk
• Created: 13/May/21 20:50
• Updated: 24/May/21 20:31
• Resolved: 24/May/21 01:36

Description

Here's some logs from a PR build vs. master that suffered a significant number of failures in the backup tests. I suspect that a single improvement could fix all of these tests to be more robust.

Test Name
Duration
Age
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestBackupDeleteRestore.testBackupDeleteRestore	6 min 23 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestBackupDeleteRestore.(?)	1 min 6 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestBackupMerge.TestIncBackupMergeRestore	5 min 3 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestBackupMerge.(?)	1 min 6 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestFullBackupSet.testFullBackupSetExist	6 min 16 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestFullBackupSet.(?)	1 min 6 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestIncrementalBackupMergeWithFailures.TestIncBackupMergeRestore	5 min 55 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestIncrementalBackupMergeWithFailures.(?)	1 min 6 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad.TestIncBackupDeleteTable	5 min 56 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad.(?)	1 min 6 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestRestoreBoundaryTests.testFullRestoreSingleEmpty	6 min 5 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestRestoreBoundaryTests.testFullRestoreMultipleEmpty	0.17 sec	1
 precommit checks / yetus jdk8 Hadoop3 checks / org.apache.hadoop.hbase.backup.TestRestoreBoundaryTests.(?)

https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3249/4/testReport/

Issue Links

• links to: GitHub Pull Request #3279