[NUTCH-2413] Parsing fetcher to respect property "parse.filter.urls"

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13
• Fix Version/s: 1.14
• Component/s: fetcher, parser

Environment

Apache Nutch release 1.13.

• Assignee: Sebastian Nagel
• Reporter: Marcos Bori
• Created: 25/Aug/17 12:15
• Updated: 13/Mar/24 14:51
• Resolved: 26/Aug/17 08:49

Description

In a situation when we want to:
(1) Execute the fetch and parse together ("fetcher.parse" setting to "true")
(2) Avoid applying the URL filters when executing this phase.

Condition (2) can be configured when parsing is executed as a separate process by setting "parse.filter.urls" to "false".
However, this setting ("parse.filter.urls") is ignored when we execute the fetch and parse phases together.