Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-1403

StandardTokenizer - Improper Hostname Recognition

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 2.3.1, 2.3.2
    • Fix Version/s: None
    • Component/s: modules/analysis
    • Labels:
      None
    • Environment:

      Java 5

    • Lucene Fields:
      New

      Description

      As of 2.3.1 the documentation for the StandardTokenizer states that it "Recognizes email addresses and internet hostnames as one token."

      However hostnames such as "my-host.com" are recognized as two tokens "my" and "host.com".

      Any host with a dash in the name is not recognized properly.

        Attachments

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LUCENE-1373 Most of the contributed Analyzers suffer from invalid recognition of acronyms.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                cwible Cullin Wible
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: