[NUTCH-2710] Normalize outlinks before checking for internal or external links

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.21
• Patch Info: Patch Available
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 25/Apr/19 13:54
• Updated: 30/Mar/24 17:19

Description

We have a normalizer that transforms external URLs back to internal URLs. But those URLs are never passed to the normalizer, because they have already been filtered out by internal and/or external host/domain checks in parseOutputFormat.filterNormalize().

This patch proposes to move the normalizers above the checks for internal/external hosts/domains.