[NUTCH-1106] Options to skip url's based on length

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3
• Fix Version/s: 1.15
• Component/s: linkdb
• Patch Info: Patch Available
• Assignee: Sebastian Nagel
• Reporter: Markus Jelsma
• Created: 09/Sep/11 12:06
• Updated: 01/Oct/19 14:29
• Resolved: 17/Jul/18 11:34

Description

Adds option to skip URL's exceeding a certain length. At first we used regex to impose this limit but having this options configurable is more convenient. Comments?

Issue Links

• relates to: NUTCH-1314 Impose a limit on the length of outlink target urls
• links to: GitHub Pull Request #359