[MAHOUT-415] Lucene filter for Collocations

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3, 0.4, 0.5
• Fix Version/s: 0.6
• Labels: bloom-filter filter index lucene
• Assignee: Drew Farris
• Reporter: Drew Farris
• Created: 14/Jun/10 03:23
• Updated: 09/Feb/12 14:01
• Resolved: 04/Jun/11 11:14

Description

Collocations generated using Mahout could be used to form a whitelist of terms to index into a Lucene index. This patch will provide a way to generate a serialized BloomFilter from CollocationsOutput and a Lucene filter that will take a BloomFilter and emit tokens that are members of that filter. This would allow a set of interesting collocations to be pre-computed for a corpus and then allow the documents to be indexed using only those collocations.