[SYSTEMDS-2065] Code generation for operator fusion v3

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Epic Name: Code generation for operator fusion v3
• Assignee: Unassigned
• Reporter: Matthias Boehm
• Created: 12/Jan/18 00:32
• Updated: 03/Aug/18 20:23

Description

This epic aims to make the existing code generation feature - introduced in SYSTEMML-1284 - production ready.

Apart from features for robustness, performance, and broader operation support this also includes the extension to generating native CPU and GPU operations, including deep-learning-specific operations.

Issue Links

• is related to: SYSTEMDS-2373 Codegen integration nary min/max
• relates to: SYSTEMDS-1284 Code generation for operator fusion

Sub-Tasks

• Candidate exploration w/ unknowns: In Progress
• Library of native vector operations: Open
• Native C/C++ template code generation: Open
• Native LLVM template code generation: Open
• Compiler utils for native code compilation/loading: Open
• Performance input/output transfers over JNI: Open
• Extended CSE for codegen plans: Open
• Codegen compiler extension for matrix multiply chains: Open
• Configurable codegen cost model weights: Open
• Runtime adaptation of code model weights: Open
• Basic GPU codegen framework and integration: Open
• GPU code generation for dense inputs: Open
• GPU code generation for sparse inputs: Open
• GPU code generation for compressed inputs: Open
• Extended codegen optimizer (CPU/GPU placement): Open
• Support for sparse vector intermediates in row templates: Open
• Extend codegen algorithm tests for heuristics FA and FNR: Open
• Add support for prod/colProds/rowProds: Open