[OPENNLP-673] Doccat NGramFeatureGenerator not working

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: tools-1.5.3
• Fix Version/s: 1.6.0
• Component/s: Doccat
• Assignee: William Colen
• Reporter: William Colen
• Created: 11/Apr/14 13:18
• Updated: 13/May/14 12:47
• Resolved: 13/May/14 12:47

Description

Training a document categorizer module using NGramFeatureGenerator always fails. All events are dropped.

(...)
Dropped event talk.religion.misc:[From:, (...)
Dropped event talk.religion.misc:[From:, (...)
done.
Sorting and merging events...

Exception in thread "main" java.lang.NullPointerException
at opennlp.tools.ml.maxent.GISTrainer.trainModel(GISTrainer.java:264)
at opennlp.tools.ml.maxent.GIS.trainModel(GIS.java:298)
at opennlp.tools.ml.maxent.GIS.doTrain(GIS.java:83)
at opennlp.tools.ml.maxent.GIS.doTrain(GIS.java:1)
at opennlp.tools.ml.AbstractEventTrainer.train(AbstractEventTrainer.java:93)
at opennlp.tools.ml.model.TrainUtil.train(TrainUtil.java:53)
at opennlp.tools.doccat.DocumentCategorizerME.train(DocumentCategorizerME.java:116)
at opennlp.tools.doccat.DoccatCrossValidator.evaluate(DoccatCrossValidator.java:72)
at opennlp.tools.cmdline.doccat.DoccatCrossValidatorTool.run(DoccatCrossValidatorTool.java:99)
at opennlp.tools.cmdline.CLI.main(CLI.java:224)
Done indexing.
Incorporating indexed data for training...