Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2899

Add OpenNLP Analysis capabilities as a module

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 7.3, 8.0
    • modules/analysis
    • None
    • New

    Description

      Now that OpenNLP is an ASF project and has a nice license, it would be nice to have a submodule (under analysis) that exposed capabilities for it. Drew Farris, Tom Morton and I have code that does:

      • Sentence Detection as a Tokenizer (could also be a TokenFilter, although it would have to change slightly to buffer tokens)
      • NamedEntity recognition as a TokenFilter

      We are also planning a Tokenizer/TokenFilter that can put parts of speech as either payloads (PartOfSpeechAttribute?) on a token or at the same position.

      I'd propose it go under:
      modules/analysis/opennlp

      Attachments

        1. OpenNLPTokenizer.java
          6 kB
          Em
        2. OpenNLPFilter.java
          8 kB
          Em
        3. LUCENE-2899-RJN.patch
          317 kB
          Rene Nederhand
        4. LUCENE-2899-6.1.0.patch
          262 kB
          Steven Rowe
        5. LUCENE-2899.patch
          247 kB
          Lance Norskog
        6. LUCENE-2899.patch
          252 kB
          Steven Rowe
        7. LUCENE-2899.patch
          263 kB
          Steven Rowe
        8. LUCENE-2899.patch
          261 kB
          Steven Rowe
        9. LUCENE-2899.patch
          261 kB
          Steven Rowe
        10. LUCENE-2899.patch
          588 kB
          Steven Rowe

        Issue Links

          Activity

            People

              sarowe Steven Rowe
              gsingers Grant Ingersoll
              Votes:
              36 Vote for this issue
              Watchers:
              62 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: