[NUTCH-1294] IndexClean job with solr implementation.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: nutchgora
• Fix Version/s: 2.3
• Patch Info: Patch Available
• Assignee: Unassigned
• Reporter: Dan Rosher
• Created: 01/Mar/12 15:46
• Updated: 01/May/14 06:23
• Resolved: 13/Aug/13 15:28

Description

I started by copying/altering the trunk version of SolrClean, though is was inadequate for our needs. We needed to mark particular pages as gone even though they still might be visible on the web, this implementation abstracts the index cleaning process, has a Solr implementation, and adds a clean index plugin extension that allows others to tailor how pages might be removed from their store.