[SOLR-9229] TestNRTOpen.testSharedCores() failures

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 5.5.2
• Assignee: Steven Rowe
• Reporter: Steven Rowe
• Created: 20/Jun/16 16:12
• Updated: 25/Jun/16 20:33
• Resolved: 20/Jun/16 23:10

Description

My Jenkins found a reproducing TestNRTOpen.testSharedCores() failure on branch_5_5, and git bisect pointed the finger at SOLR-9034:

Checking out Revision c6b9ac065571718e7e92174fa7e2a927583012fa (refs/remotes/origin/branch_5_5)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestNRTOpen -Dtests.method=testSharedCores -Dtests.seed=7C31F56A2C49EB56 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar-LB -Dtests.timezone=Asia/Magadan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.21s J5  | TestNRTOpen.testSharedCores <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7C31F56A2C49EB56:9A32BF25A4BFC659]:0)
   [junit4]    > 	at org.apache.solr.core.TestNRTOpen.testSharedCores(TestNRTOpen.java:117)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)

But Policeman Jenkins found another reproducing branch_5_5 seed http://jenkins.thetaphi.de/job/Lucene-Solr-5.5-Linux/310/consoleText, and git bisect instead blames SOLR-8621:

Checking out Revision c6b9ac065571718e7e92174fa7e2a927583012fa (refs/remotes/origin/branch_5_5)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestNRTOpen -Dtests.method=testSharedCores -Dtests.seed=A2B2DA22BF73E3AF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-HN -Dtests.timezone=Libya -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.49s J1 | TestNRTOpen.testSharedCores <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<3> but was:<1>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A2B2DA22BF73E3AF:44B1906D3785CEA0]:0)
   [junit4]    > 	at org.apache.solr.core.TestNRTOpen.testSharedCores(TestNRTOpen.java:116)

And when I go back and look at Jenkins emails, the first modern failure for this test was just a couple hours after SOLR-8621 was committed http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/15516/ - this reproduces for me on current branch_5_5:

  [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestNRTOpen -Dtests.method=testSharedCores -Dtests.seed=1A4EC986938AC08C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-PH -Dtests.timezone=America/Cayman -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
  [junit4] FAILURE 0.31s J1 | TestNRTOpen.testSharedCores <<<
  [junit4]    > Throwable #1: java.lang.AssertionError: expected:<3> but was:<1>
  [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1A4EC986938AC08C:FC4D83C91B7CED83]:0)
  [junit4]    > 	at org.apache.solr.core.TestNRTOpen.testSharedCores(TestNRTOpen.java:116)

However, when the above seed fails on my box, the point at which the failure occurs as well as the cause are different from above:

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestNRTOpen -Dtests.method=testSharedCores -Dtests.seed=1A4EC986938AC08C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=en-PH -Dtests.timezone=America/Cayman -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.24s | TestNRTOpen.testSharedCores <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<[org.apache.lucene.index.SegmentCoreReaders@69824fe7, org.apache.lucene.index.SegmentCoreReaders@68a89668, org.apache.lucene.index.SegmentCoreReaders@488b9d9f]> but was:<[org.apache.lucene.index.SegmentCoreReaders@3829a0a0, org.apache.lucene.index.SegmentCoreReaders@69824fe7, org.apache.lucene.index.SegmentCoreReaders@68a89668]>
   [junit4]    >        at __randomizedtesting.SeedInfo.seed([1A4EC986938AC08C:FC4D83C91B7CED83]:0)
   [junit4]    >        at org.apache.solr.core.TestNRTOpen.testSharedCores(TestNRTOpen.java:124)

Issue Links

• is related to: SOLR-9225 TestGroupingSearch.testGroupAPI() failures
• is related to: SOLR-8674 increase <mergePolicy> vs. <mergePolicyFactory> test coverage
• is related to: SOLR-9222 TestIndexSearcher.testReopen() failures on branch_5_5
• relates to: SOLR-8674 increase <mergePolicy> vs. <mergePolicyFactory> test coverage
• relates to: SOLR-8621 solrconfig.xml: deprecate/replace <mergePolicy> with <mergePolicyFactory>