[SOLR-13796] Fix Solr Test Performance

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Mark Miller
• Reporter: Mark Miller
• Created: 26/Sep/19 15:41
• Updated: 21/Jan/20 16:56
• Resolved: 31/Oct/19 17:22

Description

I had kind of forgotten, but while working on Starburst I had realized that almost all of our tests are capable of being very fast and logging 10x less as a result. When they get this fast, a lot of infrequent random fails become frequent and things become much easier to debug. I had fixed a lot of issue to make tests pretty damn fast in the starburst branch, but tons of tests where still ignored due to the scope of changes going on.

A variety of things have converged that have allowed me to absorb most of that work and build up on it while also almost finishing it.

This will be another huge PR aimed at addressing issues that have our tests often take dozens of seconds to minutes when they should take mere seconds or 10.

As part of this issue, I would like to move the focus of non nightly tests towards being more minimal, consistent and fast.

In exchanged, we must put more effort and care in nightly tests. Not something that happens now, but if we have solid, fast, consistent non Nightly tests, that should open up some room for Nightly to get some status boost.

Issue Links

• blocks: SOLR-13452 Update the lucene-solr build from Ivy+Ant+Maven (shadow build) to Gradle.
• is part of: SOLR-12801 Fix the tests, remove BadApples and AwaitsFix annotations, improve env for test development.
• is related to: SOLR-13867 Make Solrcloud stable and performant and capable of having passing tests.