[NUTCH-521] Modified injector to allow newly injected CrawlDatum to overwrite original

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.0
• Component/s: injector

Environment

Tested on Solaris and Windows with Java 1.5

• Assignee: Unassigned
• Reporter: Rob Young
• Created: 19/Jul/07 09:49
• Updated: 01/Apr/11 15:26
• Resolved: 01/Apr/11 15:26

Description

Before this patch if a CrawlDatum is already in the crawldb then it will be used in preference to the CrawlDatum created by the newly injected url. This patch gives the user the ability to force the injected CrawlDatum to be used instead. The use case for this patch was the requirement for injected urls to jump to the top of the TopN list so that we can garuntee they will be crawled immediately (usefull for intranet crawling where changes can trigger injects).