[NUTCH-2537] Logical OR instead of AND in UrlExemptionFilters

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: plugin
• Assignee: Unassigned
• Reporter: Semyon Semyonov
• Created: 16/Mar/18 18:01
• Updated: 16/Mar/18 18:05

Description

With NUTCH-2522 another urlexemptionfilter is added, therefore now we can combine the filters.
We should use more reasonable combination of ExemptionFilters based on OR, instead of AND.

The following code should be modified 
URLExemptionFilters.java : 66
for (int i = 0; i < this.filters.length && exempted; i++)

{ exempted = this.filters[i].filter(fromUrl, toUrl); }

Issue Links

• relates to: NUTCH-2522 Bidirectional URL exemption filter