Uploaded image for project: 'OpenNLP'
  1. OpenNLP
  2. OPENNLP-1265

Improve speed of lang detect

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Over on TIKA-2790, we found that opennlp's language detector is far, far slower than Optimaize and yalder.

      Let's use this ticket to see what we can do to improve lang detect's speed.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. OPENNLP-1267 Allow the LanguageDetector to stop before processing the full string

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. OPENNLP-1266 Limit normalization regexes in UrlCharSequenceNormalizer

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. OPENNLP-1269 Add alternate to NGramModel that uses straight Strings rather than StringList

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed

          Activity

            People

              tallison Tim Allison
              tallison Tim Allison
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: