[OPENNLP-202] Refactor the sentence detector to correctly detect white spaces

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: tools-1.5.1-incubating
• Fix Version/s: tools-1.5.2-incubating
• Component/s: Sentence Detector
• Assignee: Jörn Kottmann
• Reporter: Jörn Kottmann
• Created: 09/Jun/11 21:45
• Updated: 06/Jul/11 09:32
• Resolved: 06/Jul/11 09:32

Description

The Sentence Detector code needs a robust mechanism to detect the precense of a white space. In OpenNLP white spaces should be detected with StringUtil.isWhitespace, but the Sentence Detector either call Chracter.isWhitespace or equals a character with the space character.

To fix this issue refactor the code to always use StringUtil.isWhitespace to detect whites spaces.