[NUTCH-2482] index-geoip not to add null values to document fields

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.13
• Fix Version/s: 1.16
• Component/s: indexer, plugin
• Labels: patch-available
• Assignee: Sebastian Nagel
• Reporter: Sebastian Nagel
• Created: 15/Dec/17 15:32
• Updated: 28/Jan/21 13:56
• Resolved: 30/Sep/19 07:24

Description

The plugin index-geoip may add null values to document fields which then cause further errors, here a NPE in IndexingFiltersChecker when toString() is called on null:

$ bin/nutch indexchecker -Dstore.ip.address=true -Dindex.geoip.usage=cityDatabase \
     -Dplugin.includes="protocol-http|parse-html|index-(basic|geoip)" http://www.example.com/
...
Exception in thread "main" java.lang.NullPointerException
        at org.apache.nutch.indexer.IndexingFiltersChecker.fetch(IndexingFiltersChecker.java:340)
        at org.apache.nutch.indexer.IndexingFiltersChecker.run(IndexingFiltersChecker.java:127)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.nutch.indexer.IndexingFiltersChecker.main(IndexingFiltersChecker.java:370)

Issue Links

• links to: GitHub Pull Request #476