Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2008

IndexerMapReduce to use single instance of NutchIndexAction for deletions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • 1.10
    • 1.11
    • indexer
    • None
    • Patch Available

    Description

      For every URL/document to be deleted a new instance of NutchIndexAction is created in IndexerMapReduce (in multiple positions):

      NutchIndexAction action = new NutchIndexAction(null,
         NutchIndexAction.DELETE);
      output.collect(key, action);
      

      Since the index action does not hold any data specific to any URL/document it would be more efficient to re-use a single instance.

      Attachments

        1. NUTCH-2008-trunk-v1.patch
          3 kB
          Sebastian Nagel
        2. NUTCH-2008-trunk-v2.patch
          3 kB
          Sebastian Nagel

        Activity

          People

            snagel Sebastian Nagel
            snagel Sebastian Nagel
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: