[SYSTEMDS-2023] RDD collect of compressed matrix fails w/ NPE

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemML 1.0.0
• Epic Link: Perftest and QA for SystemML 1.0 release
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 20/Nov/17 06:38
• Updated: 20/Nov/17 06:59
• Resolved: 20/Nov/17 06:59

Description

Any RDD collect of a compressed matrix with more than one block currently fails as follows

Caused by: java.lang.NullPointerException
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.copySparseToDense(MatrixBlock.java:1576)
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.copy(MatrixBlock.java:1485)
	at org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:850)
	at org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:776)
	at org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:499)
	at org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:1)
	at org.apache.sysml.runtime.controlprogram.caching.CacheableData.acquireRead(CacheableData.java:426)
	at org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.getBroadcastForVariable(SparkExecutionContext.java:544)
	at org.apache.sysml.runtime.instructions.spark.SpoofSPInstruction.processInstruction(SpoofSPInstruction.java:125)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:264)