[OPENNLP-1190] CONLL02 format

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: tools-1.5.3
• Component/s: Formats
• Flags: Patch, Important
• Assignee: Martin Wiesner
• Reporter: Luca
• Created: 26/Mar/18 10:06
• Updated: 15/Oct/23 06:53
• Resolved: 01/Sep/23 14:54

Description

According to the documentation, the following should work

 bin/opennlp TokenNameFinderConverter conll02 -data esp.train -lang es -types per > es_corpus_train_persons.txt

However currently it delivers error message since  it expects 3 columns instead of 2 that are in the dataset.

This is a bug, introduced at line 130 of   opennlp.tools.formats.Conll02NameSampleStream.java where a length of 3 is imposed.

Issue Links

• relates to: OPENNLP-1191 achieve compatibility with stanford 2 column input