Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-7352

TestSimpleExplanationsWithFillerDocs failures

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 7.0
    • 6.2, 7.0
    • core/search
    • None
    • New

    Description

      Policeman Jenkins found reproducible testDMQ8() and testDMQ9() failures on master http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17037/:

      Checking out Revision ece9d85cbea962fd7d327010f1ba184cefdfa8ed (refs/remotes/origin/master)
[...]
[junit4] Suite: org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSimpleExplanationsWithFillerDocs -Dtests.method=testDMQ8 -Dtests.seed=882B619046E7216B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fo -Dtests.timezone=Asia/Ashgabat -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.10s J2 | TestSimpleExplanationsWithFillerDocs.testDMQ8 <<<
   [junit4]    > Throwable #1: junit.framework.AssertionFailedError: (+((field:yy (field:w5)^100.0) | (field:xx)^100000.0)~0.5 -extra:extra) NEVER:MATCH: score(doc=713)=-1.9956312E-6 != explanationScore=-3.9912625E-6 Explanation: -3.9912625E-6 = sum of:
   [junit4]    >   -3.9912625E-6 = weight(field:w5 in 713) [RandomSimilarity], result of:
   [junit4]    >     -3.9912625E-6 = score(IBSimilarity, doc=713, freq=1.0), computed from:
   [junit4]    >       100.0 = boost
   [junit4]    >       0.0 = NormalizationH2, computed from: 
   [junit4]    >         1.0 = tf
   [junit4]    >         5.502638 = avgFieldLength
   [junit4]    >         5.6493154E19 = len
   [junit4]    >       0.2533109 = LambdaTTF, computed from: 
   [junit4]    >         2256.0 = totalTermFreq
   [junit4]    >         8909.0 = numberOfDocuments
   [junit4]    >       -3.9912624E-8 = DistributionSPL
   [junit4]    >  expected:<-1.9956312E-6> but was:<-3.9912625E-6>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([882B619046E7216B:D4118BC551735775]:0)
   [junit4]    > 	at junit.framework.Assert.fail(Assert.java:50)
   [junit4]    > 	at junit.framework.Assert.failNotEquals(Assert.java:287)
   [junit4]    > 	at junit.framework.Assert.assertEquals(Assert.java:120)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:338)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits$ExplanationAsserter.collect(CheckHits.java:501)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.AssertingCollector$1.collect(AssertingCollector.java:56)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.Weight$DefaultBulkScorer.scoreRange(Weight.java:196)
   [junit4]    > 	at org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:183)
   [junit4]    > 	at org.apache.lucene.search.AssertingBulkScorer.score(AssertingBulkScorer.java:79)
   [junit4]    > 	at org.apache.lucene.search.ReqExclBulkScorer.score(ReqExclBulkScorer.java:48)
   [junit4]    > 	at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39)
   [junit4]    > 	at org.apache.lucene.search.AssertingBulkScorer.score(AssertingBulkScorer.java:69)
   [junit4]    > 	at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:669)
   [junit4]    > 	at org.apache.lucene.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:91)
   [junit4]    > 	at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:473)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.checkExplanations(CheckHits.java:310)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.checkExplanations(QueryUtils.java:104)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:132)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:128)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:118)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.checkHitCollector(CheckHits.java:98)
   [junit4]    > 	at org.apache.lucene.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:114)
   [junit4]    > 	at org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:113)
   [junit4]    > 	at org.apache.lucene.search.TestSimpleExplanations.testDMQ8(TestSimpleExplanations.java:182)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSimpleExplanationsWithFillerDocs -Dtests.method=testDMQ9 -Dtests.seed=882B619046E7216B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fo -Dtests.timezone=Asia/Ashgabat -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.09s J2 | TestSimpleExplanationsWithFillerDocs.testDMQ9 <<<
   [junit4]    > Throwable #1: junit.framework.AssertionFailedError: (+((field:yy (field:w5)^100.0) | (field:xx)^0.0)~0.5 -extra:extra) NEVER:MATCH: score(doc=713)=-1.9956312E-6 != explanationScore=-3.9912625E-6 Explanation: -3.9912625E-6 = sum of:
   [junit4]    >   -3.9912625E-6 = weight(field:w5 in 713) [RandomSimilarity], result of:
   [junit4]    >     -3.9912625E-6 = score(IBSimilarity, doc=713, freq=1.0), computed from:
   [junit4]    >       100.0 = boost
   [junit4]    >       0.0 = NormalizationH2, computed from: 
   [junit4]    >         1.0 = tf
   [junit4]    >         5.502638 = avgFieldLength
   [junit4]    >         5.6493154E19 = len
   [junit4]    >       0.2533109 = LambdaTTF, computed from: 
   [junit4]    >         2256.0 = totalTermFreq
   [junit4]    >         8909.0 = numberOfDocuments
   [junit4]    >       -3.9912624E-8 = DistributionSPL
   [junit4]    >  expected:<-1.9956312E-6> but was:<-3.9912625E-6>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([882B619046E7216B:15279865D6AD44BE]:0)
   [junit4]    > 	at junit.framework.Assert.fail(Assert.java:50)
   [junit4]    > 	at junit.framework.Assert.failNotEquals(Assert.java:287)
   [junit4]    > 	at junit.framework.Assert.assertEquals(Assert.java:120)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:338)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.verifyExplanation(CheckHits.java:358)
   [junit4]    > 	at org.apache.lucene.search.CheckHits$ExplanationAsserter.collect(CheckHits.java:501)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.AssertingCollector$1.collect(AssertingCollector.java:56)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.AssertingLeafCollector.collect(AssertingLeafCollector.java:52)
   [junit4]    > 	at org.apache.lucene.search.Weight$DefaultBulkScorer.scoreRange(Weight.java:196)
   [junit4]    > 	at org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:183)
   [junit4]    > 	at org.apache.lucene.search.AssertingBulkScorer.score(AssertingBulkScorer.java:79)
   [junit4]    > 	at org.apache.lucene.search.ReqExclBulkScorer.score(ReqExclBulkScorer.java:48)
   [junit4]    > 	at org.apache.lucene.search.AssertingBulkScorer.score(AssertingBulkScorer.java:79)
   [junit4]    > 	at org.apache.lucene.search.AssertingBulkScorer.score(AssertingBulkScorer.java:63)
   [junit4]    > 	at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:669)
   [junit4]    > 	at org.apache.lucene.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:91)
   [junit4]    > 	at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:473)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.checkExplanations(CheckHits.java:310)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.checkExplanations(QueryUtils.java:104)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:132)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:128)
   [junit4]    > 	at org.apache.lucene.search.QueryUtils.check(QueryUtils.java:118)
   [junit4]    > 	at org.apache.lucene.search.CheckHits.checkHitCollector(CheckHits.java:98)
   [junit4]    > 	at org.apache.lucene.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:114)
   [junit4]    > 	at org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:113)
   [junit4]    > 	at org.apache.lucene.search.TestSimpleExplanations.testDMQ9(TestSimpleExplanations.java:197)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=8, maxDocsPerChunk=101, blockSize=5), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=8, blockSize=5)), sim=RandomSimilarity(queryNorm=true,coord=no): {field=IB SPL-L2, NEVER=DFR I(ne)BZ(0.3), alt=IB SPL-L1}, locale=fo, timezone=Asia/Ashgabat
   [junit4]   2> NOTE: Linux 4.4.0-24-generic i386/Oracle Corporation 9-ea (32-bit)/cpus=12,threads=1,free=25879888,total=112373760

      Attachments

        1. LUCENE-7352.patch
          1 kB
          Adrien Grand

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. LUCENE-7132 BooleanQuery scores can be diff for same docs+sim when using coord (disagree with Explanation which doesn't change)

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              Unassigned Unassigned
              sarowe Steven Rowe
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: