Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1300

Indexer to filter and normalize URL's

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 1.6
    • indexer
    • None
    • Patch Available

    Description

      Indexers should be able to normalize URL's. This is useful when a new normalizer is applied to the entire CrawlDB. Without it, some or all records in a segment cannot be indexed at all.

      Attachments

        1. NUTCH-1300-1.5-1.patch
          3 kB
          Markus Jelsma

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. NUTCH-1323 AjaxNormalizer

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. NUTCH-1614 Plugin to exclude URLs matching regex list from indexing - to enable crawl but do not index

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              markus17 Markus Jelsma
              markus17 Markus Jelsma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: