[OPENNLP-854] Character changes during Sentence Detector Training

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: tools-1.5.3
• Component/s: Sentence Detector
• Labels: newbie
• Environment: Windows 7 using opennlp-tools-1.5.3.jar directly from Command Prompt and Powershell
• Assignee: Unassigned
• Reporter: dave hey
• Created: 28/Jun/16 18:53
• Updated: 31/Jan/17 11:51
• Resolved: 31/Jan/17 11:51

Description

When I try to learn a model for detecting Sentences for Persian language, the Unicode character U+0641 changes to something else and every occurrences of this char in the input text is changing to an unknown character in output text.