[OPENNLP-524] Tokenizer does not load 1.5.0 sourceforge model

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: tools-1.5.3
• Component/s: Tokenizer
• Assignee: William Colen
• Reporter: Jörn Kottmann
• Created: 13/Jul/12 14:23
• Updated: 19/Jul/12 14:58
• Resolved: 17/Jul/12 20:48

Description

I am doing some testing (of trunk) and run into this issue.
The tokenizer refuses to load the model from the sourceforge
site.

I am getting this exception:
Caused by: java.lang.IllegalArgumentException: opennlp.tools.util.InvalidFormatException: alphaNumericPattern is a mandatory property!
at opennlp.tools.util.model.BaseModel.checkArtifactMap(BaseModel.java:470)
at opennlp.tools.util.model.BaseModel.loadModel(BaseModel.java:241)
at opennlp.tools.util.model.BaseModel.<init>(BaseModel.java:181)
at opennlp.tools.tokenize.TokenizerModel.<init>(TokenizerModel.java:125)
at opennlp.tools.cmdline.tokenizer.TokenizerModelLoader.loadModel(TokenizerModelLoader.java:39)
at opennlp.tools.cmdline.tokenizer.TokenizerModelLoader.loadModel(TokenizerModelLoader.java:31)
at opennlp.tools.cmdline.ModelLoader.load(ModelLoader.java:62)
at opennlp.tools.cmdline.tokenizer.TokenizerMETool.run(TokenizerMETool.java:41)
at opennlp.tools.cmdline.CLI.main(CLI.java:225)
... 6 more
Caused by: opennlp.tools.util.InvalidFormatException: alphaNumericPattern is a mandatory property!
at opennlp.tools.tokenize.TokenizerFactory.validateArtifactMap(TokenizerFactory.java:98)
at opennlp.tools.util.model.BaseModel.validateArtifactMap(BaseModel.java:451)
at opennlp.tools.tokenize.TokenizerModel.validateArtifactMap(TokenizerModel.java:148)
at opennlp.tools.util.model.BaseModel.checkArtifactMap(BaseModel.java:468)
... 14 more