Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1284 Code generation for operator fusion
  3. SYSTEMDS-1292

Support spark codegen instructions w/ multiple RDD inputs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Done
    • None
    • SystemML 0.15
    • Compiler, Runtime
    • None

    Description

      This task aims to support spark codegen instructions (for all templates) over multiple RDD inputs if not all side inputs fit into the local and remote broadcast memory budgets. In detail, this might entail either (1) generating custom RDD operations and functions for various combinations of input RDDs, or (2) a generalization of the related spark instructions regarding the input RDD construction and a generic function signature.

      Attachments

        Issue Links

          Activity

            People

              mboehm7 Matthias Boehm
              mboehm7 Matthias Boehm
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: