Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1321

IDNNormalizer

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      Right now, IDN's are indexed as ASCII. An IDNNormalizer is to be used with an indexer so it will encode ASCII URL's to their proper unicode equivalant.

        Attachments

        1. idnNormalizer.patch
          2 kB
          İlhami KALKAN

          Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-1681 In URLUtil.java, toUNICODE method does not work correctly

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-1320 IndexChecker and ParseChecker choke on IDN's

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                markus17 Markus Jelsma
                Reporter:
                markus17 Markus Jelsma
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: