Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-929

Enable frame csv reblock

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.11
    • None
    • None

    Description

      We aim to support the old file-based transform and the new frame-based transform at the same time. Both are isolated at compiler/runtime level with separate builtin functions. However, the file-based transform directly consumes csv files, while the frame-based transform requires a normal csv reblock as done for matrices.

      This task will enable the internal flag to inject csv reblocks for frame csv inputs. To support the old transform, we disable this flag whenever a transform call is encountered during compilation - the implication is that the file-based transform and the frame-based transform (over csv files) cannot be used in a mixed manner in a single script.

      Attachments

        Activity

          People

            mboehm7 Matthias Boehm
            mboehm7 Matthias Boehm
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: