[NUTCH-1521] CrawlDbFilter pass null url to urlNormailzers

• Type: Bug
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.7
• Fix Version/s: 1.9
• Assignee: lufeng
• Reporter: lufeng
• Due: 22/Jan/13
• Created: 22/Jan/13 07:29
• Updated: 17/Apr/14 01:59
• Resolved: 17/Apr/14 01:59

Description

urlNormalizers will get null url if we set CRAWLDB_PURGE_404, and it will throw NullPointerException. and the WARN Log will output something like this "Skipping null NullPointerException".