Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-7161

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery assertion error

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 6.7, 7.0
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      I just hit this unrelated but reproducible on master #cc75be53f9b3b86ec59cb93896c4fd5a9a5926b2 while tweaking earth's radius:

         [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=794526110651C8E6 -Dtests.locale=es-HN -Dtests.timezone=Brazil/West -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4] FAILURE 0.25s | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
         [junit4]    > Throwable #1: java.lang.AssertionError
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([794526110651C8E6:1DF67ED7BBBF4E1D]:0)
         [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320)
         [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
         [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=ClassicSimilarity, locale=es-HN, timezone=Brazil/West
         [junit4]   2> NOTE: Linux 3.13.0-71-generic amd64/Oracle Corporation 1.8.0_60 (64-bit)/cpus=8,threads=1,free=409748864,total=504889344
         [junit4]   2> NOTE: All tests run in this JVM: [TestMoreLikeThis]
         [junit4] Completed [1/1 (1!)] in 0.45s, 1 test, 1 failure <<< FAILURES!
         [junit4] 
         [junit4] 
         [junit4] Tests with failures [seed: 794526110651C8E6]:
         [junit4]   - org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
      

      Likely related to LUCENE-6954?

        Activity

        Hide
        teofili Tommaso Teofili added a comment -

        thanks Mike for reporting, I'll take a look.

        Show
        teofili Tommaso Teofili added a comment - thanks Mike for reporting, I'll take a look.
        Hide
        teofili Tommaso Teofili added a comment -

        I've managed to reproduce it with ant clean test -Dtests.seed=794526110651C8E6 without any change on geo stuff on plain master. The mentioned test is the one introduced with LUCENE-6954.

        Show
        teofili Tommaso Teofili added a comment - I've managed to reproduce it with ant clean test -Dtests.seed=794526110651C8E6 without any change on geo stuff on plain master. The mentioned test is the one introduced with LUCENE-6954 .
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 4751b83c977962a1c0904260e8cb977ed7aa2fc5 in lucene-solr's branch refs/heads/master from Tommaso Teofili
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=4751b83 ]

        LUCENE-7161 - give enough similar docs for mlt to match

        Show
        jira-bot ASF subversion and git services added a comment - Commit 4751b83c977962a1c0904260e8cb977ed7aa2fc5 in lucene-solr's branch refs/heads/master from Tommaso Teofili [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=4751b83 ] LUCENE-7161 - give enough similar docs for mlt to match
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit a62752699aa2759b6aaee1fcafb5923ce36e1969 in lucene-solr's branch refs/heads/branch_6x from Tommaso Teofili
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a627526 ]

        LUCENE-7161 - give enough similar docs for mlt to match
        (cherry picked from commit 4751b83)

        Show
        jira-bot ASF subversion and git services added a comment - Commit a62752699aa2759b6aaee1fcafb5923ce36e1969 in lucene-solr's branch refs/heads/branch_6x from Tommaso Teofili [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a627526 ] LUCENE-7161 - give enough similar docs for mlt to match (cherry picked from commit 4751b83)
        Hide
        steve_rowe Steve Rowe added a comment -

        Still getting failures at the same assertion, here's the ones I found since the commits on this issue:

        Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/112/
        Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
        
          [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=25E751FED53FC993 -Dtests.slow=true -Dtests.locale=sq-AL -Dtests.timezone=Indian/Christmas -Dtests.asserts=true -Dtests.file.encoding=UTF-8
          [junit4] FAILURE 0.11s J0 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [junit4]    > Throwable #1: java.lang.AssertionError
          [junit4]    > 	at __randomizedtesting.SeedInfo.seed([25E751FED53FC993:4154093868D14F68]:0)
          [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320)
          [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {weDontSell=PostingsFormat(name=LuceneVarGapDocFreqInterval), weSell=PostingsFormat(name=Asserting), text=PostingsFormat(name=LuceneVarGapDocFreqInterval), type=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=661, maxMBSortInHeap=5.444169477800975, sim=RandomSimilarity(queryNorm=false,coord=crazy): {weDontSell=DFR I(F)3(800.0), weSell=IB LL-D1, text=DFR I(ne)LZ(0.3), type=IB SPL-DZ(0.3)}, locale=sq-AL, timezone=Indian/Christmas
          [junit4]   2> NOTE: Mac OS X 10.11.4 x86_64/Oracle Corporation 1.8.0_72 (64-bit)/cpus=3,threads=1,free=36894360,total=54788096
          [junit4]   2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, TermsQueryTest, TestDocValuesFieldSources, TestLongNormValueSource, TestCustomScoreQuery, TestFunctionQuerySort, TestBoostedQuery, TestMoreLikeThis]
          [junit4] Completed [13/20 (1!)] on J0 in 0.42s, 6 tests, 1 failure <<< FAILURES!
        
        Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/597/
        Java: 32bit/jdk1.8.0_92 -client -XX:+UseParallelGC
        
          [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=60AAD450C5F7A579 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-Latn-BA -Dtests.timezone=America/St_Vincent -Dtests.asserts=true -Dtests.file.encoding=UTF-8
          [junit4] FAILURE 0.14s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [junit4]    > Throwable #1: java.lang.AssertionError
          [junit4]    > 	at __randomizedtesting.SeedInfo.seed([60AAD450C5F7A579:4198C9678192382]:0)
          [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320)
          [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [junit4]   2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=sr-Latn-BA, timezone=America/St_Vincent
          [junit4]   2> NOTE: Linux 4.4.0-21-generic i386/Oracle Corporation 1.8.0_92 (32-bit)/cpus=12,threads=1,free=28813616,total=48234496
          [junit4]   2> NOTE: All tests run in this JVM: [TestMoreLikeThis]
          [junit4] Completed [1/20 (1!)] on J2 in 0.89s, 6 tests, 1 failure <<< FAILURES!
        
        Build: http://jenkins.sarowe.net/job/Lucene-Solr-tests-master/6738/
        
          [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
          [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=E467DF1643BE90EA -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=et-EE -Dtests.timezone=America/Porto_Acre -Dtests.asserts=true -Dtests.file.encoding=UTF-8
          [junit4] FAILURE 0.81s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [junit4]    > Throwable #1: java.lang.AssertionError
          [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E467DF1643BE90EA:80D487D0FE501611]:0)
          [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320)
          [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {weDontSell=FST50, weSell=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=FST50, type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=98, maxMBSortInHeap=5.027511093192969, sim=RandomSimilarity(queryNorm=true,coord=no): {weDontSell=DFR I(n)L3(800.0), weSell=IB LL-DZ(0.3), text=DFR GL2, type=DFR I(ne)B3(800.0)}, locale=et-EE, timezone=America/Porto_Acre
          [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=440250896,total=514850816
          [junit4]   2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, TestFieldScoreQuery, TestMoreLikeThis]
          [junit4] Completed [13/20 (1!)] on J2 in 1.86s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - Still getting failures at the same assertion, here's the ones I found since the commits on this issue: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/112/ Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=25E751FED53FC993 -Dtests.slow=true -Dtests.locale=sq-AL -Dtests.timezone=Indian/Christmas -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 0.11s J0 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([25E751FED53FC993:4154093868D14F68]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {weDontSell=PostingsFormat(name=LuceneVarGapDocFreqInterval), weSell=PostingsFormat(name=Asserting), text=PostingsFormat(name=LuceneVarGapDocFreqInterval), type=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=661, maxMBSortInHeap=5.444169477800975, sim=RandomSimilarity(queryNorm=false,coord=crazy): {weDontSell=DFR I(F)3(800.0), weSell=IB LL-D1, text=DFR I(ne)LZ(0.3), type=IB SPL-DZ(0.3)}, locale=sq-AL, timezone=Indian/Christmas [junit4] 2> NOTE: Mac OS X 10.11.4 x86_64/Oracle Corporation 1.8.0_72 (64-bit)/cpus=3,threads=1,free=36894360,total=54788096 [junit4] 2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, TermsQueryTest, TestDocValuesFieldSources, TestLongNormValueSource, TestCustomScoreQuery, TestFunctionQuerySort, TestBoostedQuery, TestMoreLikeThis] [junit4] Completed [13/20 (1!)] on J0 in 0.42s, 6 tests, 1 failure <<< FAILURES! Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/597/ Java: 32bit/jdk1.8.0_92 -client -XX:+UseParallelGC [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=60AAD450C5F7A579 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-Latn-BA -Dtests.timezone=America/St_Vincent -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 0.14s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([60AAD450C5F7A579:4198C9678192382]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=sr-Latn-BA, timezone=America/St_Vincent [junit4] 2> NOTE: Linux 4.4.0-21-generic i386/Oracle Corporation 1.8.0_92 (32-bit)/cpus=12,threads=1,free=28813616,total=48234496 [junit4] 2> NOTE: All tests run in this JVM: [TestMoreLikeThis] [junit4] Completed [1/20 (1!)] on J2 in 0.89s, 6 tests, 1 failure <<< FAILURES! Build: http://jenkins.sarowe.net/job/Lucene-Solr-tests-master/6738/ [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=E467DF1643BE90EA -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=et-EE -Dtests.timezone=America/Porto_Acre -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 0.81s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([E467DF1643BE90EA:80D487D0FE501611]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:320) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {weDontSell=FST50, weSell=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=FST50, type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=98, maxMBSortInHeap=5.027511093192969, sim=RandomSimilarity(queryNorm=true,coord=no): {weDontSell=DFR I(n)L3(800.0), weSell=IB LL-DZ(0.3), text=DFR GL2, type=DFR I(ne)B3(800.0)}, locale=et-EE, timezone=America/Porto_Acre [junit4] 2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=440250896,total=514850816 [junit4] 2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, TestFieldScoreQuery, TestMoreLikeThis] [junit4] Completed [13/20 (1!)] on J2 in 1.86s, 6 tests, 1 failure <<< FAILURES!
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1aceb67e28136f80b31d965916cf518c4d397de7 in lucene-solr's branch refs/heads/master from Tommaso Teofili
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1aceb67 ]

        LUCENE-7161 - mitigate not enough docs test issue while looking for a better solution

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1aceb67e28136f80b31d965916cf518c4d397de7 in lucene-solr's branch refs/heads/master from Tommaso Teofili [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1aceb67 ] LUCENE-7161 - mitigate not enough docs test issue while looking for a better solution
        Hide
        steve_rowe Steve Rowe added a comment -

        Policeman Jenkins found a reproducing seed http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/16845/:

        Checking out Revision 2391b5b81dfade413d70d26da63e85cbd7245bf2 (refs/remotes/origin/master)
        [...]
          [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=12E0331668C5EB5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=he-IL -Dtests.timezone=America/Goose_Bay -Dtests.asserts=true -Dtests.file.encoding=UTF-8
          [junit4] FAILURE 0.30s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [junit4]    > Throwable #1: java.lang.AssertionError
          [junit4]    > 	at __randomizedtesting.SeedInfo.seed([12E0331668C5EB5:659D5BF7DB62D84E]:0)
          [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319)
          [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Memory doPackFST= true), type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=1575, maxMBSortInHeap=5.238800842479083, sim=ClassicSimilarity, locale=he-IL, timezone=America/Goose_Bay
          [junit4]   2> NOTE: Linux 4.4.0-21-generic i386/Oracle Corporation 1.8.0_92 (32-bit)/cpus=12,threads=1,free=3718352,total=16252928
          [junit4]   2> NOTE: All tests run in this JVM: [TestSortedSetFieldSource, TestValueSources, TestFieldScoreQuery, TestMoreLikeThis]
          [junit4] Completed [9/20 (1!)] on J2 in 0.53s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - Policeman Jenkins found a reproducing seed http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/16845/ : Checking out Revision 2391b5b81dfade413d70d26da63e85cbd7245bf2 (refs/remotes/origin/master) [...] [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=12E0331668C5EB5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=he-IL -Dtests.timezone=America/Goose_Bay -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 0.30s J2 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([12E0331668C5EB5:659D5BF7DB62D84E]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Memory doPackFST= true), type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=1575, maxMBSortInHeap=5.238800842479083, sim=ClassicSimilarity, locale=he-IL, timezone=America/Goose_Bay [junit4] 2> NOTE: Linux 4.4.0-21-generic i386/Oracle Corporation 1.8.0_92 (32-bit)/cpus=12,threads=1,free=3718352,total=16252928 [junit4] 2> NOTE: All tests run in this JVM: [TestSortedSetFieldSource, TestValueSources, TestFieldScoreQuery, TestMoreLikeThis] [junit4] Completed [9/20 (1!)] on J2 in 0.53s, 6 tests, 1 failure <<< FAILURES!
        Hide
        mikemccand Michael McCandless added a comment -

        Tommaso Teofili this didn't get backported to 6.x I think?

        Show
        mikemccand Michael McCandless added a comment - Tommaso Teofili this didn't get backported to 6.x I think?
        Hide
        teofili Tommaso Teofili added a comment -

        correct.

        Show
        teofili Tommaso Teofili added a comment - correct.
        Hide
        mikemccand Michael McCandless added a comment -

        Oh, intentionally not backported? How come?

        Show
        mikemccand Michael McCandless added a comment - Oh, intentionally not backported? How come?
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 270d3859abad184e5ac1180f5e2c837a5cf0e038 in lucene-solr's branch refs/heads/branch_6x from Tommaso Teofili
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=270d385 ]

        LUCENE-7161 - mitigate not enough docs test issue while looking for a better solution

        Show
        jira-bot ASF subversion and git services added a comment - Commit 270d3859abad184e5ac1180f5e2c837a5cf0e038 in lucene-solr's branch refs/heads/branch_6x from Tommaso Teofili [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=270d385 ] LUCENE-7161 - mitigate not enough docs test issue while looking for a better solution
        Hide
        teofili Tommaso Teofili added a comment -

        done, backported to branch_6x too.

        Show
        teofili Tommaso Teofili added a comment - done, backported to branch_6x too.
        Hide
        mikemccand Michael McCandless added a comment -

        Ahh, thanks!

        Show
        mikemccand Michael McCandless added a comment - Ahh, thanks!
        Show
        teofili Tommaso Teofili added a comment - yet another failure: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/660/testReport/junit/org.apache.lucene.queries.mlt/TestMoreLikeThis/testMultiFieldShouldReturnPerFieldBooleanQuery/
        Hide
        steve_rowe Steve Rowe added a comment -

        Yet another failure, from https://builds.apache.org/job/Lucene-Solr-SmokeRelease-master/549/:

          [smoker]    [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [smoker]    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=3FA5C26ECE58C917 -Dtests.multiplier=2 -Dtests.locale=es-PA -Dtests.timezone=US/Central -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
          [smoker]    [junit4] FAILURE 0.46s J0 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [smoker]    [junit4]    > Throwable #1: java.lang.AssertionError
          [smoker]    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3FA5C26ECE58C917:5B169AA873B64FEC]:0)
          [smoker]    [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319)
          [smoker]    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [smoker]    [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/lucene/build/smokeTestRelease/tmp/unpack/lucene-7.0.0/build/queries/test/J0/temp/lucene.queries.mlt.TestMoreLikeThis_3FA5C26ECE58C917-001
          [smoker]    [junit4]   2> NOTE: test params are: codec=Lucene62, sim=ClassicSimilarity, locale=es-PA, timezone=US/Central
          [smoker]    [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=269139656,total=342360064
          [smoker]    [junit4]   2> NOTE: All tests run in this JVM: [TermsQueryTest, TestFunctionRangeQuery, TestCustomScoreQuery, TestFunctionQuerySort, TestMoreLikeThis]
          [smoker]    [junit4] Completed [16/20 (1!)] on J0 in 0.92s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - Yet another failure, from https://builds.apache.org/job/Lucene-Solr-SmokeRelease-master/549/ : [smoker] [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [smoker] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=3FA5C26ECE58C917 -Dtests.multiplier=2 -Dtests.locale=es-PA -Dtests.timezone=US/Central -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [smoker] [junit4] FAILURE 0.46s J0 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [smoker] [junit4] > Throwable #1: java.lang.AssertionError [smoker] [junit4] > at __randomizedtesting.SeedInfo.seed([3FA5C26ECE58C917:5B169AA873B64FEC]:0) [smoker] [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319) [smoker] [junit4] > at java.lang.Thread.run(Thread.java:745) [smoker] [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/lucene/build/smokeTestRelease/tmp/unpack/lucene-7.0.0/build/queries/test/J0/temp/lucene.queries.mlt.TestMoreLikeThis_3FA5C26ECE58C917-001 [smoker] [junit4] 2> NOTE: test params are: codec=Lucene62, sim=ClassicSimilarity, locale=es-PA, timezone=US/Central [smoker] [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=269139656,total=342360064 [smoker] [junit4] 2> NOTE: All tests run in this JVM: [TermsQueryTest, TestFunctionRangeQuery, TestCustomScoreQuery, TestFunctionQuerySort, TestMoreLikeThis] [smoker] [junit4] Completed [16/20 (1!)] on J0 in 0.92s, 6 tests, 1 failure <<< FAILURES!
        Hide
        steve_rowe Steve Rowe added a comment -

        That job's history is gone; here's the info from the email sent to the dev list:

          [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
          [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=116FB7FCD72BFF28 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Africa/Ouagadougou -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
          [junit4] FAILURE 0.65s J1 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
          [junit4]    > Throwable #1: java.lang.AssertionError
          [junit4]    > 	at __randomizedtesting.SeedInfo.seed([116FB7FCD72BFF28:75DCEF3A6AC579D3]:0)
          [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319)
          [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Memory doPackFST= true), type=FSTOrd50}, docValues:{}, maxPointsInLeafNode=20, maxMBSortInHeap=5.65984835937346, sim=RandomSimilarity(queryNorm=false,coord=no): {weDontSell=DFR I(F)BZ(0.3), weSell=IB SPL-LZ(0.3), text=DFR I(ne)B3(800.0), type=DFR I(F)LZ(0.3)}, locale=th, timezone=Africa/Ouagadougou
          [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=1,free=35281856,total=67108864
          [junit4]   2> NOTE: All tests run in this JVM: [TestMoreLikeThis]
          [junit4] Completed [1/20 (1!)] on J1 in 2.67s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - That job's history is gone; here's the info from the email sent to the dev list: [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=116FB7FCD72BFF28 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Africa/Ouagadougou -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] FAILURE 0.65s J1 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([116FB7FCD72BFF28:75DCEF3A6AC579D3]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Memory doPackFST= true), type=FSTOrd50}, docValues:{}, maxPointsInLeafNode=20, maxMBSortInHeap=5.65984835937346, sim=RandomSimilarity(queryNorm=false,coord=no): {weDontSell=DFR I(F)BZ(0.3), weSell=IB SPL-LZ(0.3), text=DFR I(ne)B3(800.0), type=DFR I(F)LZ(0.3)}, locale=th, timezone=Africa/Ouagadougou [junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=1,free=35281856,total=67108864 [junit4] 2> NOTE: All tests run in this JVM: [TestMoreLikeThis] [junit4] Completed [1/20 (1!)] on J1 in 2.67s, 6 tests, 1 failure <<< FAILURES!
        Hide
        steve_rowe Steve Rowe added a comment -

        My Jenkins found a seed on branch_6x:

           [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
           [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
           [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=F41FAA899068BC32 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es -Dtests.timezone=Indian/Antananarivo -Dtests.asserts=true -Dtests.file.encoding=UTF-8
           [junit4] FAILURE 1.78s J8 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
           [junit4]    > Throwable #1: java.lang.AssertionError
           [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F41FAA899068BC32:90ACF24F2D863AC9]:0)
           [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319)
           [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
           [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=PostingsFormat(name=Asserting), text=PostingsFormat(name=Memory doPackFST= true), type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=387, maxMBSortInHeap=5.426220147465891, sim=ClassicSimilarity, locale=es, timezone=Indian/Antananarivo
           [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=418951904,total=514850816
           [junit4]   2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, BoostingQueryTest, TestMoreLikeThis]
           [junit4] Completed [7/20 (1!)] on J8 in 2.30s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - My Jenkins found a seed on branch_6x: [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=F41FAA899068BC32 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es -Dtests.timezone=Indian/Antananarivo -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 1.78s J8 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([F41FAA899068BC32:90ACF24F2D863AC9]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {weDontSell=PostingsFormat(name=Memory doPackFST= true), weSell=PostingsFormat(name=Asserting), text=PostingsFormat(name=Memory doPackFST= true), type=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=387, maxMBSortInHeap=5.426220147465891, sim=ClassicSimilarity, locale=es, timezone=Indian/Antananarivo [junit4] 2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=418951904,total=514850816 [junit4] 2> NOTE: All tests run in this JVM: [TestFunctionQueryExplanations, BoostingQueryTest, TestMoreLikeThis] [junit4] Completed [7/20 (1!)] on J8 in 2.30s, 6 tests, 1 failure <<< FAILURES!
        Hide
        steve_rowe Steve Rowe added a comment -

        My Jenkins found another seed on branch_6x, reproduces for me on master too:

           [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis
           [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
           [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=C802AA860A1EAE50 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hi -Dtests.timezone=MST7MDT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
           [junit4] FAILURE 0.92s J1 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<<
           [junit4]    > Throwable #1: java.lang.AssertionError
           [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C802AA860A1EAE50:ACB1F240B7F028AB]:0)
           [junit4]    > 	at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319)
           [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
           [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=24521, maxDocsPerChunk=816, blockSize=707), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=24521, blockSize=707)), sim=ClassicSimilarity, locale=hi, timezone=MST7MDT
           [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=376756384,total=514850816
           [junit4]   2> NOTE: All tests run in this JVM: [TestPayloadSpans, TestMoreLikeThis]
           [junit4] Completed [18/20 (1!)] on J1 in 1.76s, 6 tests, 1 failure <<< FAILURES!
        
        Show
        steve_rowe Steve Rowe added a comment - My Jenkins found another seed on branch_6x, reproduces for me on master too: [junit4] Suite: org.apache.lucene.queries.mlt.TestMoreLikeThis [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMoreLikeThis -Dtests.method=testMultiFieldShouldReturnPerFieldBooleanQuery -Dtests.seed=C802AA860A1EAE50 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hi -Dtests.timezone=MST7MDT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] FAILURE 0.92s J1 | TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([C802AA860A1EAE50:ACB1F240B7F028AB]:0) [junit4] > at org.apache.lucene.queries.mlt.TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery(TestMoreLikeThis.java:319) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=24521, maxDocsPerChunk=816, blockSize=707), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=24521, blockSize=707)), sim=ClassicSimilarity, locale=hi, timezone=MST7MDT [junit4] 2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=1,free=376756384,total=514850816 [junit4] 2> NOTE: All tests run in this JVM: [TestPayloadSpans, TestMoreLikeThis] [junit4] Completed [18/20 (1!)] on J1 in 1.76s, 6 tests, 1 failure <<< FAILURES!
        Hide
        mikemccand Michael McCandless added a comment -

        Do we have a sense of whether these ongoing failures are a test bug or a problem with LUCENE-6954? Maybe we should revert LUCENE-6954 for now?

        Show
        mikemccand Michael McCandless added a comment - Do we have a sense of whether these ongoing failures are a test bug or a problem with LUCENE-6954 ? Maybe we should revert LUCENE-6954 for now?
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 25370cd7e03b19e14b37feac2cace9aa3ae150fa in lucene-solr's branch refs/heads/master from Robert Muir
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=25370cd ]

        LUCENE-7161: disable flaky test

        Show
        jira-bot ASF subversion and git services added a comment - Commit 25370cd7e03b19e14b37feac2cace9aa3ae150fa in lucene-solr's branch refs/heads/master from Robert Muir [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=25370cd ] LUCENE-7161 : disable flaky test
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 7df2a9e2667c91aac74aac843049724b2690afac in lucene-solr's branch refs/heads/branch_6x from Robert Muir
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=7df2a9e ]

        LUCENE-7161: disable flaky test

        Show
        jira-bot ASF subversion and git services added a comment - Commit 7df2a9e2667c91aac74aac843049724b2690afac in lucene-solr's branch refs/heads/branch_6x from Robert Muir [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=7df2a9e ] LUCENE-7161 : disable flaky test
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit d7f4e25a1dd9e0f62db72fce6192e5481775c7c0 in lucene-solr's branch refs/heads/master from Robert Muir
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=d7f4e25 ]

        LUCENE-7161: remove unused import

        Show
        jira-bot ASF subversion and git services added a comment - Commit d7f4e25a1dd9e0f62db72fce6192e5481775c7c0 in lucene-solr's branch refs/heads/master from Robert Muir [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=d7f4e25 ] LUCENE-7161 : remove unused import
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit b2c983cef1caed06e76e5198f251a90e5cb34a42 in lucene-solr's branch refs/heads/branch_6x from Robert Muir
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=b2c983c ]

        LUCENE-7161: remove unused import

        Show
        jira-bot ASF subversion and git services added a comment - Commit b2c983cef1caed06e76e5198f251a90e5cb34a42 in lucene-solr's branch refs/heads/branch_6x from Robert Muir [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=b2c983c ] LUCENE-7161 : remove unused import
        Hide
        mikemccand Michael McCandless added a comment -

        Bulk move of still open issues from 6.2 to 6.3.

        Show
        mikemccand Michael McCandless added a comment - Bulk move of still open issues from 6.2 to 6.3.

          People

          • Assignee:
            teofili Tommaso Teofili
            Reporter:
            mikemccand Michael McCandless
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development