[HBASE-24128] [Flakey Tests] Add retry on thrift cmdline if client fails plus misc debug

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 2.3.0
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 06/Apr/20 22:37
• Updated: 08/Apr/20 13:16
• Resolved: 07/Apr/20 16:31

Description

    hbase-server/src/test/java/org/apache/hadoop/hbase/TestClusterPortAssignment.java
     Saw case where Master failed startup because of BindException but it came out wrapped
     in an IOE so we did not trip the BindException retry logic. Make the catch more general.

    hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
     Add some debug and up timeouts. This test fails frequently for me
     locally.

    hbase-server/src/test/java/org/apache/hadoop/hbase/client/locking/TestEntityLocks.java
     Up the wait from 2x 200ms to 10x in case a pause on hardware or GC.
     This test fails locally and up on jenkins.

    hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestClearRegionBlockCache.java
     Debug. Have assert say what bad count was.

    hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingToCellFlatMapMemStore.java
     Fails on occasion. Found count is off by a few. Tricky to debug. Adding
     sub-issue to reenable.

    hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
     Debug. Add wait and check before moving to assert.

    hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
     Check for null before shutting; can be null if failed start.

    hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServerCmdLine.java
     Add retry if client messes up connection. Fails for me locally.

Sub-Tasks

• Reenable TestCompactingToCellFlatMapMemStore: Open