[LUCENE-6968] LSH Filter

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.2, 7.0
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Tommaso Teofili
• Reporter: Cao Manh Dat
• Created: 08/Jan/16 08:27
• Updated: 28/Aug/22 14:48
• Resolved: 14/Jun/16 09:52

Description

I'm planning to implement LSH. Which support query like this

Find similar documents that have 0.8 or higher similar score with a given document. Similarity measurement can be cosine, jaccard, euclid..

For example. Given following corpus

1. Solr is an open source search engine based on Lucene
2. Solr is an open source enterprise search engine based on Lucene
3. Solr is an popular open source enterprise search engine based on Lucene
4. Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java

We wanna find documents that have 0.6 score in jaccard measurement with this doc

Solr is an open source search engine

It will return only docs 1,2 and 3 (MoreLikeThis will also return doc 4)

Issue Links

• is related to: LUCENE-7442 MinHashFilter's ctor should validate its args