[NUTCH-3025] urlfilter-fast to filter based on the length of the URL

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.19
• Fix Version/s: 1.20
• Component/s: plugin, urlfilter
• Assignee: Unassigned
• Reporter: Julien Nioche
• Created: 06/Nov/23 13:12
• Updated: 13/Mar/24 14:51
• Resolved: 08/Nov/23 19:37

Description

There currently is no filter implementation to remove URLs based on their length or the length of their path / query.
Doing so with the regex filter would be inefficient, instead we could implement it in _urlfilter-fast _

Issue Links

• links to: GitHub Pull Request #796