Mahout
  1. Mahout
  2. MAHOUT-670

Provide a performance measurement framework for Mahout

    Details

      Description

      At the moment Mahout lacks the existence of a performance test framework. The framework should be able to execute user defined performace test of distributed and non-distributed algorithms, generate reports and to detect regressions in the performace of mahout.

        Issue Links

          Activity

          Hide
          Oliver B. Fischer added a comment -

          Can someone assign this issue to me, since I will work on the implementation of such a framework.

          Show
          Oliver B. Fischer added a comment - Can someone assign this issue to me, since I will work on the implementation of such a framework.
          Hide
          Grant Ingersoll added a comment -

          No need to worry about assignment just yet, that's typically an indication that a committer is reviewing it, although for some regular contributors we might add them as assignees. Otherwise, the admin process is to onerous to constantly be adding new people as assignees.

          Show
          Grant Ingersoll added a comment - No need to worry about assignment just yet, that's typically an indication that a committer is reviewing it, although for some regular contributors we might add them as assignees. Otherwise, the admin process is to onerous to constantly be adding new people as assignees.
          Hide
          Oliver B. Fischer added a comment -

          At the moment I am working on the EC2 infrastructure part of the project. The goal is to be able to set up a EC2 cluster by providing a configuration file.

          Show
          Oliver B. Fischer added a comment - At the moment I am working on the EC2 infrastructure part of the project. The goal is to be able to set up a EC2 cluster by providing a configuration file.
          Hide
          Oliver B. Fischer added a comment -

          I created a repository for Thotti at GitHub. You can find it at https://github.com/obfischer/Thotti

          Show
          Oliver B. Fischer added a comment - I created a repository for Thotti at GitHub. You can find it at https://github.com/obfischer/Thotti
          Hide
          Sean Owen added a comment -

          Is this likely to result in a patch for Mahout, or exist as a separate project? Either is a fine outcome, and in fact might be easier to manage as the latter for now. If it is headed to Mahout, I suggest we discuss earlier than later about what you're envisioning.

          Show
          Sean Owen added a comment - Is this likely to result in a patch for Mahout, or exist as a separate project? Either is a fine outcome, and in fact might be easier to manage as the latter for now. If it is headed to Mahout, I suggest we discuss earlier than later about what you're envisioning.
          Hide
          Oliver B. Fischer added a comment -

          Hi Sean,

          I would like to see it as part of the Mahout project after I implemented a basic set of functions. I also think it will be easier to gain visibility for Thotti if it will be a part of the mahout project.

          Show
          Oliver B. Fischer added a comment - Hi Sean, I would like to see it as part of the Mahout project after I implemented a basic set of functions. I also think it will be easier to gain visibility for Thotti if it will be a part of the mahout project.
          Hide
          Oliver B. Fischer added a comment -

          I am still working on this. Sorry for the slow progress. Feel free to track the Git repository at GitHub

          Show
          Oliver B. Fischer added a comment - I am still working on this. Sorry for the slow progress. Feel free to track the Git repository at GitHub
          Hide
          Oliver B. Fischer added a comment -

          Hi Sebastian,

          the Framework is currently able to run test on AWS EC2 and EMR. Do you think it could be integrated in Mahout even if it is limited to AWS?

          Show
          Oliver B. Fischer added a comment - Hi Sebastian, the Framework is currently able to run test on AWS EC2 and EMR. Do you think it could be integrated in Mahout even if it is limited to AWS?
          Hide
          Grant Ingersoll added a comment -

          People who want this can get it off of Github, as there isn't a patch and GH is likely fine for this stuff

          Show
          Grant Ingersoll added a comment - People who want this can get it off of Github, as there isn't a patch and GH is likely fine for this stuff

            People

            • Assignee:
              Grant Ingersoll
              Reporter:
              Oliver B. Fischer
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development