[NUTCH-2349] urlnormalizer-basic NPE for ill-formed URL "http:/"

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4, 1.13
• Fix Version/s: 2.4, 1.13
• Patch Info: Patch Available
• Assignee: Sebastian Nagel
• Reporter: Sebastian Nagel
• Created: 11/Jan/17 15:05
• Updated: 13/Mar/24 14:51
• Resolved: 01/Feb/17 11:09

Description

NUTCH-2337 introduced a potential (though rare) NullPointerException when an ill-formed URL (just the protocol followed by ":", ":/", ":////" or even more slashes):

% echo "http://///" \
  | runtime/local/bin/nutch org.apache.nutch.net.URLNormalizerChecker \
     -normalizer org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer 
Checking URLNormalizer org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
Exception in thread "main" java.lang.NullPointerException
        at org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer.normalize(BasicURLNormalizer.java:120)
        at org.apache.nutch.net.URLNormalizerChecker.checkOne(URLNormalizerChecker.java:72)
        at org.apache.nutch.net.URLNormalizerChecker.main(URLNormalizerChecker.java:110)

Issue Links

• links to: GitHub Pull Request #169