[SYSTEMDS-2853] Refactor spoof cuda runtime operations

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: SystemDS 2.1
• Fix Version/s: SystemDS 2.1
• Component/s: Compiler, Internals, NativeRuntime
• Labels: CUDA GPU codegen runtime
• Epic Link: spoof-cuda
• Assignee: Mark Dokter
• Reporter: Mark Dokter
• Created: 08/Feb/21 11:37
• Updated: 26/Feb/21 12:39
• Resolved: 26/Feb/21 12:39

Description

Similarly to the compilation step, the runtime part of cuda codegen needs improvement by specializing to avoid conditionals while executing runtime instructions.

This improvement will refactor the SpoofCUDA runtime gpu instruction into the generic part preparing input from the cache and specific SpoofOperator derived classes per codegen template to handle template specific extras like temporary memory and output dimensions.

Error handling needs improvement by catching native exceptions and have the Java version of the operator executed as a backup.

The single/double precision floating point variants should be instantiated at startup time in the fashion of the interface CudaSupportFunctions.