[SYSTEMDS-1897] Perftest: multinomial mlogreg/naivebayes failing w/ codegen enabled

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemML 0.15
• Epic Link: Code generation for operator fusion
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 07/Sep/17 20:37
• Updated: 08/Sep/17 19:28
• Resolved: 08/Sep/17 19:28

Description

The perftest scenarios multinomial, 100Kx1K and 1Mx1K dense/sparse are currently failing for Mlogreg and Naive Bayes if codegen is enabled. In detail, we get the following index out of bounds exception:

Caused by: org.apache.sysml.runtime.DMLRuntimeException: java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException
	at org.apache.sysml.runtime.codegen.SpoofCellwise.execute(SpoofCellwise.java:276)
	at org.apache.sysml.runtime.instructions.cp.SpoofCPInstruction.processInstruction(SpoofCPInstruction.java:87)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:266)
	... 16 more
Caused by: java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.sysml.runtime.codegen.SpoofCellwise.execute(SpoofCellwise.java:256)

A similar but distinct issue which lets some Mlogreg instances fail manifests as follows

Caused by: java.lang.ArrayIndexOutOfBoundsException: 4
	at org.apache.sysml.runtime.codegen.SpoofCellwise.executeSparseColAggSum(SpoofCellwise.java:729)
	at org.apache.sysml.runtime.codegen.SpoofCellwise.executeSparse(SpoofCellwise.java:348)
	at org.apache.sysml.runtime.codegen.SpoofCellwise.execute(SpoofCellwise.java:236)
	at org.apache.sysml.runtime.instructions.cp.SpoofCPInstruction.processInstruction(SpoofCPInstruction.java:87)
	at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:266)
	... 16 more