Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1595

Missing Block Sizes For PersistentWrites & TransientWrites

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.15
    • None
    • None

    Description

      In the attached script, the resulting PersisentWrites for doutc1_agg & dWc1_agg end up having unknown block sizes, despite the input DAGs for those variables having known block sizes. Due to this, when we use MLContext and mark those variables as outputs, the PersistentWrites will be rewritten to TransientWrites, and the block sizes will remain unknown.

      To run:

      spark-submit $SYSTEMML_HOME/target/SystemML.jar -f scenario1.dml -explain recompile_hops

      Attachments

        1. scenario1.dml
          2 kB
          Mike Dusenberry

        Issue Links

          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-540 Deep Learning

          • Major - Major loss of function.
          • In Progress

          Activity

            People

              mboehm7 Matthias Boehm
              dusenberrymw Mike Dusenberry
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: