[SYSTEMDS-3436] CLA ArrayOutOfBounds in sample

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: SystemDS 3.1
• Fix Version/s: SystemDS 3.1
• Epic Link: Extended CLA
• Assignee: Unassigned
• Reporter: Sebastian Baunsgaard
• Created: 13/Sep/22 09:06
• Updated: 15/Mar/23 19:14
• Resolved: 13/Sep/22 16:58

Description


An Error Occurred :
DMLRuntimeException – org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in for program block generated from for statement block between lines 0 and 0 – Error evaluating for program block
DMLRuntimeException – ERROR: Runtime error in for program block generated from for statement block between lines 0 and 0 – Error evaluating for program block
DMLRuntimeException – ERROR: Runtime error in program block generated from statement block between lines 4 and 6 – Error evaluating instruction: CP°compress°pREADX·MATRIX·FP64°_mVar2·MATRIX·FP64
DMLCompressionException – Multithreaded first extraction failed
ExecutionException – org.apache.sysds.runtime.compress.DMLCompressionException: ColGroup extraction failed
DMLCompressionException – ColGroup extraction failed
ArrayIndexOutOfBoundsException – Index -1 out of bounds for length 75

org.apache.sysds.runtime.DMLRuntimeException: org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in for program block generated from for statement block between lines 0 and 0 – Error evaluating for program block
at org.apache.sysds.runtime.controlprogram.Program.execute(Program.java:164)
at org.apache.sysds.api.ScriptExecutorUtils.executeRuntimeProgram(ScriptExecutorUtils.java:89)
at org.apache.sysds.api.DMLScript.execute(DMLScript.java:461)
at org.apache.sysds.api.DMLScript.executeScript(DMLScript.java:304)
at org.apache.sysds.api.DMLScript.main(DMLScript.java:198)
Caused by: org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in for program block generated from for statement block between lines 0 and 0 – Error evaluating for program block
at org.apache.sysds.runtime.controlprogram.ForProgramBlock.execute(ForProgramBlock.java:164)
at org.apache.sysds.runtime.controlprogram.Program.execute(Program.java:158)
... 4 more
Caused by: org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in program block generated from statement block between lines 4 and 6 – Error evaluating instruction: CP°compress°pREADX·MATRIX·FP64°_mVar2·MATRIX·FP64
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:291)
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:204)
at org.apache.sysds.runtime.controlprogram.BasicProgramBlock.execute(BasicProgramBlock.java:125)
at org.apache.sysds.runtime.controlprogram.ForProgramBlock.execute(ForProgramBlock.java:143)
... 5 more
Caused by: org.apache.sysds.runtime.compress.DMLCompressionException: Multithreaded first extraction failed
at org.apache.sysds.runtime.compress.estim.AComEst.CompressedSizeInfoColGroupParallel(AComEst.java:267)
at org.apache.sysds.runtime.compress.estim.AComEst.CompressedSizeInfoColGroup(AComEst.java:227)
at org.apache.sysds.runtime.compress.estim.AComEst.computeCompressedSizeInfos(AComEst.java:83)
at org.apache.sysds.runtime.compress.CompressedMatrixBlockFactory.classifyPhase(CompressedMatrixBlockFactory.java:302)
at org.apache.sysds.runtime.compress.CompressedMatrixBlockFactory.compressMatrix(CompressedMatrixBlockFactory.java:280)
at org.apache.sysds.runtime.compress.CompressedMatrixBlockFactory.compress(CompressedMatrixBlockFactory.java:203)
at org.apache.sysds.runtime.compress.CompressedMatrixBlockFactory.compress(CompressedMatrixBlockFactory.java:134)
at org.apache.sysds.runtime.instructions.cp.CompressionCPInstruction.processInstruction(CompressionCPInstruction.java:73)
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:255)
... 8 more
Caused by: java.util.concurrent.ExecutionException: org.apache.sysds.runtime.compress.DMLCompressionException: ColGroup extraction failed
at java.base/java.util.concurrent.ForkJoinTask.get(ForkJoinTask.java:1006)
at org.apache.sysds.runtime.compress.estim.AComEst.CompressedSizeInfoColGroupParallel(AComEst.java:260)
... 16 more
Caused by: org.apache.sysds.runtime.compress.DMLCompressionException: ColGroup extraction failed
at org.apache.sysds.runtime.compress.estim.AComEst$SizeEstimationTask.call(AComEst.java:290)
at java.base/java.util.concurrent.ForkJoinTask$AdaptedCallable.exec(ForkJoinTask.java:1448)
at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.lang.ArrayIndexOutOfBoundsException: Index -1 out of bounds for length 75
at org.apache.sysds.runtime.compress.estim.sample.SampleEstimatorFactory.getInvertedFrequencyHistogram(SampleEstimatorFactory.java:108)
at org.apache.sysds.runtime.compress.estim.sample.SampleEstimatorFactory.distinctCount(SampleEstimatorFactory.java:68)
at org.apache.sysds.runtime.compress.estim.sample.SampleEstimatorFactory.distinctCount(SampleEstimatorFactory.java:47)
at org.apache.sysds.runtime.compress.estim.ComEstSample.distinctCountScale(ComEstSample.java:167)
at org.apache.sysds.runtime.compress.estim.ComEstSample.scaleFactors(ComEstSample.java:123)
at org.apache.sysds.runtime.compress.estim.ComEstSample.extractInfo(ComEstSample.java:110)
at org.apache.sysds.runtime.compress.estim.ComEstSample.getColGroupInfo(ComEstSample.java:82)
at org.apache.sysds.runtime.compress.estim.AComEst.getColGroupInfo(AComEst.java:98)
at org.apache.sysds.runtime.compress.estim.AComEst$SizeEstimationTask.call(AComEst.java:286)
... 6 more

Issue Links

• links to: GitHub Pull Request #1694
• links to: GitHub Pull Request #1695