Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1595

Missing Block Sizes For PersistentWrites & TransientWrites

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.15
    • None
    • None

    Description

      In the attached script, the resulting PersisentWrites for doutc1_agg & dWc1_agg end up having unknown block sizes, despite the input DAGs for those variables having known block sizes. Due to this, when we use MLContext and mark those variables as outputs, the PersistentWrites will be rewritten to TransientWrites, and the block sizes will remain unknown.

      To run:

      spark-submit $SYSTEMML_HOME/target/SystemML.jar -f scenario1.dml -explain recompile_hops

      Attachments

        Issue Links

        relates to

        Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-540 Deep Learning

        • Major - Major loss of function.
        • In Progress

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mboehm7 Matthias Boehm
            dusenberrymw Mike Dusenberry
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment