[SOLR-13060] Some Nightly HDFS tests never terminate on ASF Jenkins, triggering whole-job timeout, causing Jenkins to kill JVMs, causing dump files to be created that fill all disk space, causing failure of all following jobs on the same node

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.1, 9.0
• Component/s: Hadoop Integration, Tests
• Assignee: Kevin Risden
• Reporter: Steven Rowe
• Created: 12/Dec/18 02:14
• Updated: 12/May/22 00:26
• Resolved: 25/Feb/19 16:30

Description

The 3 tests that are affected:

• HdfsAutoAddReplicasIntegrationTest
• HdfsCollectionsAPIDistributedZkTest
• MoveReplicaHDFSTest

Instances from the dev list:

12/1: https://lists.apache.org/thread.html/e04ad0f9113e15f77393ccc26e3505e3090783b1d61bd1c7ff03d33e@%3Cdev.lucene.apache.org%3E

12/5: https://lists.apache.org/thread.html/d78c99255abfb5134803c2b77664c1a039d741f92d6e6fcbcc66cd14@%3Cdev.lucene.apache.org%3E

12/8: https://lists.apache.org/thread.html/92ad03795ae60b1e94859d49c07740ca303f997ae2532e6f079acfb4@%3Cdev.lucene.apache.org%3E

12/8: https://lists.apache.org/thread.html/26aace512bce0b51c4157e67ac3120f93a99905b40040bee26472097@%3Cdev.lucene.apache.org%3E

12/11: https://lists.apache.org/thread.html/33558a8dd292fd966a7f476bf345b66905d99f7eb9779a4d17b7ec97@%3Cdev.lucene.apache.org%3E

Issue Links

• is related to: SOLR-9111 HdfsCollectionsAPIDistributedZkTest stalled for over 75 hours
• is related to: SOLR-12869 Unit test stalling
• is related to: SOLR-13074 MoveReplicaHDFSTest leaks threads, falls into an endless loop, logging like crazy
• is related to: LUCENE-8604 Add TestRuleLimitSysouts tests, do some cleanup and add hard limit
• is related to: SOLR-13338 HdfsAutoAddReplicasIntegrationTest failures