Uploaded image for project: 'OpenNLP'
  1. OpenNLP
  2. OPENNLP-1266

Limit normalization regexes in UrlCharSequenceNormalizer

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.9.4
    • None
    • None

    Description

      The MAIL_REGEX in UrlCharSequenceNormalizer is unbounded and requires backtracking. In rare cases, this can cause eye-opening performance costs.

       

      I tested the other regexes in the other normalizers.  I could be wrong, but they don't appear to require backtracking, and there are no surprising performance costs.

      Attachments

        Issue Links

          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. OPENNLP-1350 MAIL_REGEX in UrlCharSequenceNormalizer causes quadratic complexity for certain input, and is also a bit imprecise

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Task - A task that needs to be done. OPENNLP-1265 Improve speed of lang detect

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #355

          Activity

            People

              tallison Tim Allison
              tallison Tim Allison
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: