[NUTCH-359] extraction of links will fail for whole page if one single link cannot be parsed

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.8
• Fix Version/s: 1.0.0
• Component/s: fetcher

Environment

Ubuntu Dapper

• Assignee: Unassigned
• Reporter: Renaud Richardet
• Created: 23/Aug/06 23:23
• Updated: 10/Apr/09 12:29
• Resolved: 22/Sep/08 16:07

Description

When Nutch parses the outlinks of a fetched page, the process will fail if a single link cannot be parsed (e.g. java.net.MalformedURLException: unknown protocol). The attached patch will keep indexing the remaining links on that page even if one fails.