[LUCENE-2899] Add OpenNLP Analysis capabilities as a module

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 7.3, 8.0
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Steven Rowe
• Reporter: Grant Ingersoll
• Created: 30/Jan/11 15:44
• Updated: 27/Sep/22 09:15
• Resolved: 19/Dec/17 00:13

Description

Now that OpenNLP is an ASF project and has a nice license, it would be nice to have a submodule (under analysis) that exposed capabilities for it. Drew Farris, Tom Morton and I have code that does:

• Sentence Detection as a Tokenizer (could also be a TokenFilter, although it would have to change slightly to buffer tokens)
• NamedEntity recognition as a TokenFilter

We are also planning a Tokenizer/TokenFilter that can put parts of speech as either payloads (PartOfSpeechAttribute?) on a token or at the same position.

I'd propose it go under:
modules/analysis/opennlp

Issue Links

• depends upon: SOLR-3623 inconsistent treatment of lucene jars & third-party deps in analysis-extras & uima (in war and in lucene-libs)
• is related to: SOLR-4793 Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
• mentioned in: Page Loading...