[SOLR-8542] Integrate Learning to Rank into Solr

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.4, 7.0
• Assignee: Christine Poerschke
• Reporter: Joshua Pantony
• Created: 13/Jan/16 19:56
• Updated: 03/Aug/21 17:04
• Resolved: 06/Jan/17 21:38

Description

This is a ticket to integrate learning to rank machine learning models into Solr. Solr Learning to Rank (LTR) provides a way for you to extract features directly inside Solr for use in training a machine learned model. You can then deploy that model to Solr and use it to rerank your top X search results. This concept was previously presented by the authors at Lucene/Solr Revolution 2015.

---

Solr Reference Guide documentation:

• https://cwiki.apache.org/confluence/display/solr/Learning+To+Rank

Source code and README files:

• solr/contrib/ltr
• solr/contrib/ltr/example

Issue Links

• breaks: SOLR-9746 Eclipse project broken due to duplicate package-info.java in LTR contrib
• is related to: SOLR-10667 Solr packaging doesn't include Learn To Rank examples
• is related to: SOLR-9929 Documentation and sample code about how to train the model using user clicks when use ltr module
• relates to: SOLR-10005 solr/contrib/ltr : add missing class-level javadocs
• relates to: SOLR-15569 MultipleAdditiveTreesModel does not split as expected when the node value equals the split threshold
• relates to: SOLR-10192 fix copy/paste in solr/contrib/ltr/pom.xml.template
• relates to: SOLR-10283 SolrFeature fails to reject searches with missing efi (if used by fq)
• relates to: SOLR-10963 Sample model json format for MultipleAdditiveTreesModel is incorrect
• relates to: SOLR-10383 NPE on debug query in SOLR UI - LTR OriginalScoreFeature
• relates to: SOLR-10421 solr/contrib/ltr (MinMax|Standard)Normalizer.paramsToMap needs to save float as string
• relates to: SOLR-11163 Normalizer fails to restore itself when reload or restart solr cores.
• relates to: SOLR-10451 Remove contrib/ltr/lib from lib includes in the techproducts example config
• relates to: SOLR-8183 Add Learning to Rank framework to Solr
• relates to: SOLR-10081 Web UI (Generate Training Data ) for LTR plugin
• relates to: SOLR-10811 Speed up MultipleAdditiveTreesModel by using QuickScorer algorithm
• relates to: SOLR-10077 TestManagedFeatureStore extends LuceneTestCase, but has no tests and just hosts a static method.
• relates to: SOLR-10072 The test TestSelectiveWeightCreation appears to be unreliable.
• relates to: SOLR-10174 fix 3x in @Ignore TestLTRReRankingPipeline and TestMultipleAdditiveTreesModel
• relates to: LEGAL-276 SOLR-8542 contribution and potential patent concerns
• requires: SOLR-9161 SolrPluginUtils.invokeSetters should accommodate setter variants
• requires: SOLR-9412 Update Macro Expander for replacement logic
• requires: SOLR-9331 Can we remove ReRankQuery's length constructor argument?
• requires: SOLR-9353 factor out ReRankQParserPlugin.ReRankQueryRescorer private class
• requires: SOLR-9543 reduce code duplication in ReRankQParserPlugin.ReRankCollector.topDocs
• requires: SOLR-9567 factor out ReRankCollector from ReRankQParserPlugin
• requires: SOLR-9574 factor out AbstractReRankQuery class
• requires: SOLR-9410 make ReRankQParserPlugin's private ReRankWeight public
• links to: GitHub Pull Request #4
• links to: GitHub Pull Request #40
• links to: GitHub Pull Request #40