[SYSTEMDS-2670] Null pointer on cache cleanup in remote parfor

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemDS 2.0
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 22/Sep/20 13:55
• Updated: 22/Sep/20 16:39
• Resolved: 22/Sep/20 16:39

Description

20/09/22 15:38:22 WARN scheduler.TaskSetManager: Lost task 144.2 in stage 0.0 (TID 793, sierra.dm.isds.tugraz.at, executor 10): 
java.lang.NullPointerException
        at org.apache.sysds.runtime.controlprogram.caching.LazyWriteBuffer.deleteBlock(LazyWriteBuffer.java:127)
        at org.apache.sysds.runtime.controlprogram.caching.CacheableData.freeEvictedBlob(CacheableData.java:922)
        at org.apache.sysds.runtime.controlprogram.parfor.RemoteParForUtils.exportResultVariables(RemoteParForUtils.java:184)
        at org.apache.sysds.runtime.controlprogram.parfor.RemoteParForSparkWorker.call(RemoteParForSparkWorker.java:114)
        at org.apache.sysds.runtime.controlprogram.parfor.RemoteParForSparkWorker.call(RemoteParForSparkWorker.java:1)
        at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$3$1.apply(JavaRDDLike.scala:143)
        at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$3$1.apply(JavaRDDLike.scala:143)