Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-2832

Algorithmic Level Performance Suite

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • SystemDS 3.0
    • None

    Description

      This task is to take some of the algorithms and setup a test suite, that show performance of the system with different properties of the input data set.

      https://github.com/apache/systemds/tree/master/scripts/perftest

      There are two main approaches:

      select common data set and train to competitive accuracy.

      generate data, with specific properties and run algorithms a fixed set of iterations.

      The entire process from the downloading of data set, to preprocessing before the algorithm is run have to be automated to the point of a single script being executed, and resulting in performance numbers. If preprocessing is required, then bench marking this is also valuable.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            baunsgaard Sebastian Baunsgaard
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment