Mahout
  1. Mahout
  2. MAHOUT-524

DisplaySpectralKMeans example fails

    Details

      Description

      I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments and a bug fix in EigenCleanupJob it runs spectral k-means to completion. The display example is expecting 2-d clustered points and the example is producing 5-d points. Additional I/O work is needed before this will play with the rest of the clustering algorithms.

      1. spectralkmeans.png
        43 kB
        Shannon Quinn
      2. SpectralKMeans_fail_20110919.txt
        6 kB
        Lance Norskog
      3. raw.txt
        14 kB
        Shannon Quinn
      4. MAHOUT-524.patch
        9 kB
        Grant Ingersoll
      5. MAHOUT-524.patch
        5 kB
        Grant Ingersoll
      6. MAHOUT-524.patch
        13 kB
        Shannon Quinn
      7. EclipseLog_20110918.txt
        14 kB
        Lance Norskog
      8. ASF.LICENSE.NOT.GRANTED--screenshot-1.jpg
        46 kB
        Grant Ingersoll
      9. aff.txt
        2.38 MB
        Shannon Quinn

        Activity

        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Grant Ingersoll made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Shannon Quinn made changes -
        Attachment MAHOUT-524.patch [ 12508680 ]
        Rozemary Scarlat made changes -
        Comment [ Hi! I am new to Mahout and I have been trying to use the K-means Spectral Clustering, but I ran into the problem described in the comments above: the Lancsoz solver tries to input the output of the VectorMatrixMultipliction as a "calculations/laplacian-166/tmp/data" file, instead of the "calculations/laplacian-166/part-m-00000".
        I was wondering if currently there is a way to a run the Spectral Clustering. ]
        Grant Ingersoll made changes -
        Attachment screenshot-1.jpg [ 12502050 ]
        Grant Ingersoll made changes -
        Attachment MAHOUT-524.patch [ 12502048 ]
        Grant Ingersoll made changes -
        Attachment MAHOUT-524.patch [ 12502041 ]
        Lance Norskog made changes -
        Attachment SpectralKMeans_fail_20110919.txt [ 12495183 ]
        Lance Norskog made changes -
        Attachment EclipseLog_20110918.txt [ 12495016 ]
        Sean Owen made changes -
        Assignee Jeff Eastman [ jeastman ] Shannon Quinn [ magsol ]
        Sean Owen made changes -
        Labels clustering k-means visualization
        Assignee Jeff Eastman [ jeastman ]
        Fix Version/s 0.6 [ 12316364 ]
        Affects Version/s 0.5 [ 12315255 ]
        Sean Owen made changes -
        Fix Version/s 0.5 [ 12315255 ]
        Shannon Quinn made changes -
        Attachment spectralkmeans.png [ 12468940 ]
        Shannon Quinn made changes -
        Attachment aff.txt [ 12468658 ]
        Attachment raw.txt [ 12468659 ]
        Jeff Eastman made changes -
        Field Original Value New Value
        Fix Version/s 0.5 [ 12315255 ]
        Fix Version/s 0.4 [ 12314396 ]
        Description I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments it gets remarkably far through, finally failing on W.transpose() after the eigen cleanup. I can't imagine this would all be pilot error so I'm opening an issue to track it. I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments and a bug fix in EigenCleanupJob it runs spectral k-means to completion. The display example is expecting 2-d clustered points and the example is producing 5-d points. Additional I/O work is needed before this will play with the rest of the clustering algorithms.
        Jeff Eastman created issue -

          People

          • Assignee:
            Shannon Quinn
            Reporter:
            Jeff Eastman
          • Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development