[SOLR-12040] HdfsBasicDistributedZkTest & HdfsBasicDistributedZk2 fail on virtually every jenkins run

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.1, 9.0
• Component/s: Hadoop Integration, hdfs, Tests
• Assignee: Kevin Risden
• Reporter: Chris M. Hostetter
• Created: 27/Feb/18 19:04
• Updated: 12/May/22 00:26
• Resolved: 26/Mar/19 19:58

Description

HdfsBasicDistributedZkTest & HdfsBasicDistributedZk2 are thin subclasses of BasicDistributedZkTest & BasicDistributedZk2 that just tweak the setup to use HDFS, and only run @Nightly.

These tests are failing virtually every time they are run by jenkins - either at a method level, or at a suite level (due to threadleaks, timeouts, etc...) yet their non-HDFS superclasss virtually never fail.

Per the jenkins failure rates reports i've setup, here's the failure rates of all tests matching "BasicDistributed" for the past 7days (note that the non-HDFS tests aren't even listed, because they haven't failed at all even though they are non-nightly and have cumulatively run ~750 times in the past 7 days)

http://fucit.org/solr-jenkins-reports/failure-report.html

"Suite?","Class","Method","Rate","Runs","Fails"
"true","org.apache.solr.cloud.hdfs.HdfsBasicDistributedZk2Test","","53.3333333333333","15","8"
"false","org.apache.solr.cloud.hdfs.HdfsBasicDistributedZk2Test","test","18.75","16","3"
"true","org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest","","46.1538461538462","13","6"
"false","org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest","test","7.69230769230769","13","1"

Issue Links

• is related to: SOLR-13330 Improve HDFS tests