[OPENNLP-240] Full-Stop detection not working during full NLP parse - ASF JIRA

XML

Word

Printable

JSON

Type: Bug
Status: Closed
Priority: Major
Resolution: Not A Problem
Affects Version/s: tools-1.5.1-incubating
Fix Version/s: None
Component/s: Parser
Labels:
None
Environment:

Hide
Win 7, JDK1.6.0_23

Example Instantiation:

public Parse parse(String line) {
if(parser == null)
parser = ParserFactory.create(new ParserModel(new FileInputStream(_NLPModelPath+"/en-parser-chunking.bin")));
return ParserTool.parseLine(line, parser, 1)[0];
}// :end parse

Show
Win 7, JDK1.6.0_23 Example Instantiation: public Parse parse(String line) { if(parser == null) parser = ParserFactory.create(new ParserModel(new FileInputStream(_NLPModelPath+"/en-parser-chunking.bin"))); return ParserTool.parseLine(line, parser, 1)[0]; }// :end parse

There seems to be an issue with OpenNLP detecting the full stop at the end of the sentence

(TOP (S (NP (PRP I)) (VP (VBP intend) (S (VP (TO to) (VP (VB quit) (NP (NP (NN smoking)) (NP (DT this) (NN month.)))))))))

Although it does work fine with the tokenizer on its own

[I, intend, to, quit, smoking, this, month, .]