[SOLR-10710] LTR contrib failures

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 7.0
• Component/s: contrib - LTR
• Assignee: Unassigned
• Reporter: Steven Rowe
• Created: 18/May/17 17:20
• Updated: 02/Oct/19 17:30

Description

Reproducing failures https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1304/ - git bisect says 06a6034d9, the commit on LUCENE-7730, is where the TestFieldLengthFeature.testRanking() failure started:

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFieldLengthFeature -Dtests.method=testRanking -Dtests.seed=740EF58DAA5926DA -Dtests.slow=true -Dtests.locale=ja-JP -Dtests.timezone=America/Port_of_Spain -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.06s J1 | TestFieldLengthFeature.testRanking <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: '8'!='1' @ response/docs/[0]/id
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([740EF58DAA5926DA:EB385C1332233915]:0)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:248)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:192)
   [junit4]    > 	at org.apache.solr.ltr.feature.TestFieldLengthFeature.testRanking(TestFieldLengthFeature.java:117)

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestParallelWeightCreation -Dtests.method=testLTRScoringQueryParallelWeightCreationResultOrder -Dtests.seed=740EF58DAA5926DA -Dtests.slow=true -Dtests.locale=ar-SD -Dtests.timezone=Europe/Skopje -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   1.59s J1 | TestParallelWeightCreation.testLTRScoringQueryParallelWeightCreationResultOrder <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: '3'!='4' @ response/docs/[0]/id
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([740EF58DAA5926DA:1142D5ED603B4132]:0)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:248)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:192)
   [junit4]    > 	at org.apache.solr.ltr.TestParallelWeightCreation.testLTRScoringQueryParallelWeightCreationResultOrder(TestParallelWeightCreation.java:45)

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSelectiveWeightCreation -Dtests.method=testSelectiveWeightsRequestFeaturesFromDifferentStore -Dtests.seed=740EF58DAA5926DA -Dtests.slow=true -Dtests.locale=hr-HR -Dtests.timezone=Australia/Victoria -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.03s J1 | TestSelectiveWeightCreation.testSelectiveWeightsRequestFeaturesFromDifferentStore <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: '3'!='4' @ response/docs/[0]/id
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([740EF58DAA5926DA:293FE248276551B1]:0)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:248)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:192)
   [junit4]    > 	at org.apache.solr.ltr.TestSelectiveWeightCreation.testSelectiveWeightsRequestFeaturesFromDifferentStore(TestSelectiveWeightCreation.java:230)

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRQParserPlugin -Dtests.method=ltrMoreResultsThanReRankedTest -Dtests.seed=740EF58DAA5926DA -Dtests.slow=true -Dtests.locale=es-NI -Dtests.timezone=Africa/Mogadishu -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.03s J1 | TestLTRQParserPlugin.ltrMoreResultsThanReRankedTest <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: '0.09271725'!='0.105360515' @ response/docs/[3]/score
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([740EF58DAA5926DA:BD7644EA7596711B]:0)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:248)
   [junit4]    > 	at org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:192)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRQParserPlugin.ltrMoreResultsThanReRankedTest(TestLTRQParserPlugin.java:94)

Issue Links

• is broken by: LUCENE-7730 Better encode length normalization in similarities
• links to: GitHub Pull Request #204