[SYSTEMDS-3437] CLA Invalid Unique estimate DDC

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: SystemDS 3.1
• Fix Version/s: SystemDS 3.1
• Component/s: Compress
• Assignee: Unassigned
• Reporter: Sebastian Baunsgaard
• Created: 15/Sep/22 17:26
• Updated: 02/Dec/23 19:06
• Resolved: 19/Jan/23 16:13

Description

org.apache.sysds.runtime.DMLRuntimeException: org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in program block generated from statement block between lines 1 and 5 – Error evaluating instruction: CP°uak+°_sbcvar0·MATRIX·FP64°_Var2·SCALAR·STRING°16
at org.apache.sysds.runtime.controlprogram.Program.execute(Program.java:164)
at org.apache.sysds.api.ScriptExecutorUtils.executeRuntimeProgram(ScriptExecutorUtils.java:89)
at org.apache.sysds.api.DMLScript.execute(DMLScript.java:461)
at org.apache.sysds.api.DMLScript.executeScript(DMLScript.java:304)
at org.apache.sysds.api.DMLScript.main(DMLScript.java:198)
Caused by: org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in program block generated from statement block between lines 1 and 5 – Error evaluating instruction: CP°uak+°_sbcvar0·MATRIX·FP64°_Var2·SCALAR·STRING°16
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:291)
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:204)
at org.apache.sysds.runtime.controlprogram.BasicProgramBlock.execute(BasicProgramBlock.java:125)
at org.apache.sysds.runtime.controlprogram.Program.execute(Program.java:158)
... 4 more
Caused by: org.apache.sysds.runtime.DMLRuntimeException: Aggregate In parallel failed.
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.aggregateInParallel(CLALibCompAgg.java:276)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.agg(CLALibCompAgg.java:226)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.aggregateUnary(CLALibCompAgg.java:125)
at org.apache.sysds.runtime.compress.CompressedMatrixBlock.aggregateUnaryOperations(CompressedMatrixBlock.java:486)
at org.apache.sysds.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:251)
at org.apache.sysds.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:255)
... 7 more
Caused by: java.util.concurrent.ExecutionException: org.apache.sysds.runtime.compress.DMLCompressionException: Invalid number unique expected: 1979 but is actually: 1978 type: CHAR
at java.base/java.util.concurrent.ForkJoinTask.get(ForkJoinTask.java:1006)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.sumResults(CLALibCompAgg.java:296)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.reduceAllFutures(CLALibCompAgg.java:403)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.reduceFutures(CLALibCompAgg.java:379)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.aggregateInParallel(CLALibCompAgg.java:272)
... 12 more
Caused by: org.apache.sysds.runtime.compress.DMLCompressionException: Invalid number unique expected: 1979 but is actually: 1978 type: CHAR
at org.apache.sysds.runtime.compress.colgroup.mapping.AMapToData.getCounts(AMapToData.java:395)
at org.apache.sysds.runtime.compress.colgroup.ColGroupDDC.getCounts(ColGroupDDC.java:240)
at org.apache.sysds.runtime.compress.colgroup.AColGroupValue.getCounts(AColGroupValue.java:78)
at org.apache.sysds.runtime.compress.colgroup.AColGroupValue.computeSum(AColGroupValue.java:104)
at org.apache.sysds.runtime.compress.colgroup.AColGroupCompressed.sum(AColGroupCompressed.java:156)
at org.apache.sysds.runtime.compress.colgroup.AColGroupCompressed.unaryAggregateOperations(AColGroupCompressed.java:134)
at org.apache.sysds.runtime.compress.colgroup.AColGroupCompressed.unaryAggregateOperations(AColGroupCompressed.java:124)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.aggColOrAll(CLALibCompAgg.java:461)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg.agg(CLALibCompAgg.java:455)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg$UnaryAggregateTask.call(CLALibCompAgg.java:545)
at org.apache.sysds.runtime.compress.lib.CLALibCompAgg$UnaryAggregateTask.call(CLALibCompAgg.java:514)
at java.base/java.util.concurrent.ForkJoinTask$AdaptedCallable.exec(ForkJoinTask.java:1448)
at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)

Issue Links

• links to: GitHub Pull Request #1696