[NUTCH-3041] Address confusing logging in o.a.n.net.URLExemptionFilters

• Type: Task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.19, 1.20
• Fix Version/s: 1.21
• Component/s: net
• Assignee: Lewis John McGibbney
• Reporter: Lewis John McGibbney
• Created: 20/Apr/24 01:28
• Updated: 16/May/24 03:36
• Resolved: 16/May/24 03:08

Description

URLExemptionFilter impementations are used to allow exemptions to external domain resources by overriding the db.ignore.external.links configuration setting. This is useful when the crawl is focused to a domain but resources like images are hosted on CDN.

Currently URLExemptionFilters] provides the following logging

INFO o.a.n.n.URLExemptionFilters LocalJobRunner Map Task Executor #0 Found 0 extensions at point:'org.apache.nutch.net.URLExemptionFilter'

I find this confusing. It would be better to log only if an URLExemptionFilter implementation is actually configured to be used at runtime.

I will provide a patch for this.

Issue Links

• links to: GitHub Pull Request #813