[SYSTEMDS-864] Meta data operations after csv frame read w/ unknown size

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: SystemML 0.11
• Fix Version/s: SystemML 0.11
• Component/s: Runtime
• Epic Link: Frame data type support
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 22/Aug/16 17:17
• Updated: 17/Sep/16 03:24
• Resolved: 17/Sep/16 03:24

Description

In execution modes singlenode, hadoop, hybrid no reblocks are injected for frames of format "csv". Accordingly, any nrow/ncol after a frame csv read with unknown size fail with the following exception.

Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid meta data returned by 'nrow': -1
        at org.apache.sysml.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:122)
        at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)

We already have a special case for matrices in execution mode singlenode, which reads the matrix and updates the meta data on the fly. This functionality should be extended for frames too.