[SYSTEMDS-1014] Perftest: Multilogreg, L sparse, icpt=2 fails w/ allocation error

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: SystemML 0.11
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 06/Oct/16 20:59
• Updated: 07/Oct/16 18:30
• Resolved: 07/Oct/16 18:30

Description

In a recent run of our perf test suite with newly generated input data, Mlogreg with icpt=2 over the 10Mx1K, sparse input data is failing with the following exceptions:

Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error in program block generated from statement block between lines 115 and 122 -- Error evaluating instruction: CP°^2°X·MATRIX·DOUBLE°2·SCALAR·INT·true°_mVar31·MATRIX·DOUBLE
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:335)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:224)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:168)
	at org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:145)
	... 12 more
Caused by: java.lang.RuntimeException: Dense in-memory matrix block (10000000x1001) exceeds supported size of 2147483647 elements (16GB). Please, reduce the JVM heapsize to execute this in MR.
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.allocateDenseBlock(MatrixBlock.java:356)
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.allocateDenseBlock(MatrixBlock.java:388)
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.allocateDenseBlock(MatrixBlock.java:335)
	at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.unsafeBinaryScalar(LibMatrixBincell.java:1046)
	at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.bincellOp(LibMatrixBincell.java:98)
	at org.apache.sysml.runtime.matrix.data.MatrixBlock.scalarOperations(MatrixBlock.java:2781)
	at org.apache.sysml.runtime.instructions.cp.ScalarMatrixArithmeticCPInstruction.processInstruction(ScalarMatrixArithmeticCPInstruction.java:55)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)
	... 15 more

Issue Links

• Is contained by: SYSTEMDS-1010 Perftest 0.11 release and related improvements