[SYSTEMDS-2920] Spark rexpand fails for non-literal max parameters

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemDS 2.1
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 31/Mar/21 17:46
• Updated: 01/Apr/21 20:34
• Resolved: 01/Apr/21 20:34

Description

Distributed SliceLine (remote parfor), USCensus w/ max level L=4

An Error Occured :
      DMLRuntimeException -- org.apache.sysds.runtime.DMLRuntimeException: ERROR: Runtime error in program block generated from statement block between lines 1 and 6 -- Error evaluating instruction: CP°fcall°.defaultNS°m_slicefinder°true°10°3°X=pREADX·MATRIX·FP64°e=pREADe·MATRIX·FP64°k=10·SCALAR·INT64·true°maxL=4·SCALAR·INT64·true°alpha=0.95·SCALAR·FP64·true°minSup=24583.0·SCALAR·FP64·true°tpBlksz=4·SCALAR·INT64·true°verbose=true·SCALAR·BOOLEAN·true°tpEval=true·SCALAR·BOOLEAN·true°selFeat=false·SCALAR·BOOLEAN·true°S°C°D
      DMLRuntimeException -- ERROR: Runtime error in program block generated from statement block between lines 1 and 6 -- Error evaluating instruction: CP°fcall°.defaultNS°m_slicefinder°true°10°3°X=pREADX·MATRIX·FP64°e=pREADe·MATRIX·FP64°k=10·SCALAR·INT64·true°maxL=4·SCALAR·INT64·true°alpha=0.95·SCALAR·FP64·true°minSup=24583.0·SCALAR·FP64·true°tpBlksz=4·SCALAR·INT64·true°verbose=true·SCALAR·BOOLEAN·true°tpEval=true·SCALAR·BOOLEAN·true°selFeat=false·SCALAR·BOOLEAN·true°S°C°D
      DMLRuntimeException -- error executing function .defaultNS::m_slicefinder
      DMLRuntimeException -- ERROR: Runtime error in function program block generated from function statement block between lines 41 and 134 -- Error evaluating function program block
      DMLRuntimeException -- ERROR: Runtime error in while program block generated from while statement block between lines 84 and 126 -- Error evaluating while program block
      DMLRuntimeException -- ERROR: Runtime error in program block generated from statement block between lines 89 and 89 -- Error evaluating instruction: CP°fcall°.defaultNS°getPairedCandidates°true°12°1°S=S·MATRIX·FP64°R=R·MATRIX·FP64°TK=TK·MATRIX·FP64°TKC=TKC·MATRIX·FP64°k=10·SCALAR·INT64·true°level=4·SCALAR·INT64·true°eAvg=2.546490744563791E-4·SCALAR·FP64·true°minSup=24583.0·SCALAR·FP64·true°alpha=0.95·SCALAR·FP64·true°n2=378·SCALAR·INT64·true°foffb=foffb·MATRIX·FP64°foffe=foffe·MATRIX·FP64°S
      DMLRuntimeException -- error executing function .defaultNS::getPairedCandidates
      DMLRuntimeException -- ERROR: Runtime error in function program block generated from function statement block between lines 219 and 312 -- Error evaluating function program block
      DMLRuntimeException -- ERROR: Runtime error in if program block generated from if statement block between lines 243 and 311 -- Error evaluating if statement body
      DMLRuntimeException -- ERROR: Runtime error in program block generated from statement block between lines 285 and 296 -- Error evaluating instruction: SPARK°rexpand°cast=true°max=_Var4333°ignore=false°dir=rows°target=ID°_mVar4334·MATRIX·FP64
    NumberFormatException -- For input string: "_Var4333"