Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1142

ParFor execution crashes bc of singlethreaded warning in LibMatrixDNN

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.11
    • ParFor
    • None
    • ParFor Spark on Cluster with DeepLearning usecase

    Description

      When using functions from the LibMatrixDNN in a Spark ParFor block an exception is thrown by the function `warnSingleThreaded()` due to single threaded execution of functions such as conv2d.

      Disabling this warning resolves the crash but I am not sure this is the right way to go there. The question is also why this executes with one thread only and how to improve here.

      cc niketanpansare

      Attachments

        Issue Links

          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-540 Deep Learning

          • Major - Major loss of function.
          • In Progress

          Activity

            People

              niketanpansare Niketan Pansare
              fschueler Felix Schueler
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: