Mahout
  1. Mahout
  2. MAHOUT-777

Improve TransposeJob to use a Combiner

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.6
    • Fix Version/s: 0.6
    • Component/s: Math
    • Labels:
      None

      Description

      I saw that TransposeJob has a comment that it needs a rewrite to use a combiner. If we emit vectors instead of MatrixEntryWritables we should be able to "merge" them in a combiner.

      1. MAHOUT-777.patch
        6 kB
        Sebastian Schelter

        Activity

        Hide
        Hudson added a comment -

        Integrated in Mahout-Quality #998 (See https://builds.apache.org/job/Mahout-Quality/998/)
        MAHOUT-777 Improve TransposeJob to use a Combiner

        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160591
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/TransposeJob.java
        Show
        Hudson added a comment - Integrated in Mahout-Quality #998 (See https://builds.apache.org/job/Mahout-Quality/998/ ) MAHOUT-777 Improve TransposeJob to use a Combiner ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160591 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/TransposeJob.java
        Hide
        Sean Owen added a comment -

        Looks OK to me.

        Show
        Sean Owen added a comment - Looks OK to me.
        Hide
        Dmitriy Lyubimov added a comment -

        looks reasonable.

        Show
        Dmitriy Lyubimov added a comment - looks reasonable.
        Hide
        Sebastian Schelter added a comment -

        Jake, can you take a look at the patch?

        Show
        Sebastian Schelter added a comment - Jake, can you take a look at the patch?

          People

          • Assignee:
            Sebastian Schelter
            Reporter:
            Sebastian Schelter
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development