Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2899

Add OpenNLP Analysis capabilities as a module

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.3, master (8.0)
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Now that OpenNLP is an ASF project and has a nice license, it would be nice to have a submodule (under analysis) that exposed capabilities for it. Drew Farris, Tom Morton and I have code that does:

      • Sentence Detection as a Tokenizer (could also be a TokenFilter, although it would have to change slightly to buffer tokens)
      • NamedEntity recognition as a TokenFilter

      We are also planning a Tokenizer/TokenFilter that can put parts of speech as either payloads (PartOfSpeechAttribute?) on a token or at the same position.

      I'd propose it go under:
      modules/analysis/opennlp

        Attachments

        1. OpenNLPTokenizer.java
          6 kB
          Em
        2. OpenNLPFilter.java
          8 kB
          Em
        3. LUCENE-2899-RJN.patch
          317 kB
          Rene Nederhand
        4. LUCENE-2899-6.1.0.patch
          262 kB
          Steve Rowe
        5. LUCENE-2899.patch
          247 kB
          Lance Norskog
        6. LUCENE-2899.patch
          252 kB
          Steve Rowe
        7. LUCENE-2899.patch
          263 kB
          Steve Rowe
        8. LUCENE-2899.patch
          261 kB
          Steve Rowe
        9. LUCENE-2899.patch
          261 kB
          Steve Rowe
        10. LUCENE-2899.patch
          588 kB
          Steve Rowe

          Issue Links

            Activity

              People

              • Assignee:
                steve_rowe Steve Rowe
                Reporter:
                gsingers Grant Ingersoll
              • Votes:
                36 Vote for this issue
                Watchers:
                68 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: