[CTAKES-253] YTEX ctakes patches port

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.1
• Component/s: ctakes-core
• Environment: platform independent
• Assignee: Pei Chen
• Reporter: Vijay Garla
• Created: 29/Oct/13 02:03
• Updated: 04/Jun/14 20:45
• Resolved: 04/Nov/13 16:52

Description

This patch contains a variety of hardening fixes from the ytex distribution for ctakes (originally developed for ctakes 2.5, but the bugs remain in ctakes 3.2).

• ctakes-context-tokenizer\src\main\java\org\apache\ctakes\contexttokenizer\ae\ContextDependentTokenizerAnnotator.java
  add null check: changed to avoid NPE in case BaseToken is null. Also ignore newline tokens (they should be treated as whitespace).
• ctakes-core\src\main\java\org\apache\ctakes\core\fsm\adapters\NumberTokenAdapter.java
  add null check: ignore empty numbertokens
• ctakes-core\src\main\java\org\apache\ctakes\core\fsm\machine\DateFSM.java
  Modified to include years in dates