Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1300

Indexer to filter and normalize URL's

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.6
    • indexer
    • None
    • Patch Available

    Description

      Indexers should be able to normalize URL's. This is useful when a new normalizer is applied to the entire CrawlDB. Without it, some or all records in a segment cannot be indexed at all.

      Attachments

        Issue Links

        is depended upon by

        New Feature - A new feature of the product, which has yet to be developed. NUTCH-1323 AjaxNormalizer

        • Major - Major loss of function.
        • Resolved
        is duplicated by

        Improvement - An improvement or enhancement to an existing feature or task. NUTCH-1614 Plugin to exclude URLs matching regex list from indexing - to enable crawl but do not index

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            markus17 Markus Jelsma
            markus17 Markus Jelsma
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment