Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1336

Optionally not index db_notmodified pages

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.5
    • 1.6
    • indexer
    • None
    • Patch Available

    Description

      IndexerMapReduce already skips pages with fetch_notmodified as status. However, despite the fetch status, we may still consider a page not modified if status is db_notmodified.

      Attachments

        1. NUTCH-1336-1.6-1.patch
          2 kB
          Markus Jelsma

        Activity

          People

            markus17 Markus Jelsma
            markus17 Markus Jelsma
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: