[UIMA-2670] FileSystemCollectionReader doesn't set lastSegment correctly

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.4.0SDK
• Component/s: Examples
• Assignee: Unassigned
• Reporter: Jens Grivolla
• Created: 14/Feb/13 11:08
• Updated: 21/Oct/13 18:13

Description

FileSystemCollectionReader only sets lastSegment=true (in the SourceDocumentInformation) on the last document. Given that it loads individual documents, not segments of a document, this should be "true" for each CAS that it generates.

This is a problem when later using a CAS multiplier to segment the CAS. It should be possible to check whether the CAS is a complete document or a segment by testing for "offsetInSource==0 && lastSegment==true".

in org.apache.uima.examples.cpe.FileSystemCollectionReader:166

srcDocInfo.setLastSegment(mCurrentIndex == mFiles.size());

should be:

srcDocInfo.setLastSegment(true);