[HBASE-24131] [Flakey Tests] TestExportSnapshot takes too long; up against 13min max

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 2.3.0
• Hadoop Flags: Reviewed
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 07/Apr/20 03:53
• Updated: 02/Jun/20 17:18
• Resolved: 08/Apr/20 20:24

Description

TestExportSnapshot fails fairly regularly locally. Looking, its test timeout. Looking at how long it ran, its 13minutes plus. Looking at recent successful branch-2 run, it passed but it took about 7-8minutes. Let me break up the test into to pieces.

org.junit.runners.model.TestTimedOutException: test timed out after 780 seconds
at org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFileSystemState(TestExportSnapshot.java:227)
at org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportRetry(TestExportSnapshot.java:267)

... I see this in the log:

====> TEST TIMED OUT. PRINTING THREAD DUMP. <====

Test started at:

2020-04-06 17:19:21,739 INFO

... and the timestamp just above the TIMED OUT was

2020-04-06 17:31:01,758

Issue Links

• is related to: HBASE-24493 [flakey test] TestExportSnapshot family of tests failing due to timeout in AbstractDelegationTokenSecretManager$ExpiredTokenRemover
• links to: GitHub Pull Request #1452

Sub-Tasks

• [Flakey Tests] Add adjunct Mob and Security ExportSnapshot unit tests that subclass TestExportSnapshotAdjunct: Open
• [Flakey Tests] TestSecureExportSnapshot FileNotFoundException: Resolved