Mahout
  1. Mahout
  2. MAHOUT-524

DisplaySpectralKMeans example fails

    Details

      Description

      I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments and a bug fix in EigenCleanupJob it runs spectral k-means to completion. The display example is expecting 2-d clustered points and the example is producing 5-d points. Additional I/O work is needed before this will play with the rest of the clustering algorithms.

      1. aff.txt
        2.38 MB
        Shannon Quinn
      2. raw.txt
        14 kB
        Shannon Quinn
      3. spectralkmeans.png
        43 kB
        Shannon Quinn
      4. EclipseLog_20110918.txt
        14 kB
        Lance Norskog
      5. SpectralKMeans_fail_20110919.txt
        6 kB
        Lance Norskog
      6. MAHOUT-524.patch
        9 kB
        Grant Ingersoll
      7. MAHOUT-524.patch
        5 kB
        Grant Ingersoll
      8. ASF.LICENSE.NOT.GRANTED--screenshot-1.jpg
        46 kB
        Grant Ingersoll
      9. MAHOUT-524.patch
        13 kB
        Shannon Quinn
      There are no Sub-Tasks for this issue.

        Activity

        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Grant Ingersoll made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Shannon Quinn made changes -
        Attachment MAHOUT-524.patch [ 12508680 ]
        Rozemary Scarlat made changes -
        Comment [ Hi! I am new to Mahout and I have been trying to use the K-means Spectral Clustering, but I ran into the problem described in the comments above: the Lancsoz solver tries to input the output of the VectorMatrixMultipliction as a "calculations/laplacian-166/tmp/data" file, instead of the "calculations/laplacian-166/part-m-00000".
        I was wondering if currently there is a way to a run the Spectral Clustering. ]
        Grant Ingersoll made changes -
        Attachment screenshot-1.jpg [ 12502050 ]
        Grant Ingersoll made changes -
        Attachment MAHOUT-524.patch [ 12502048 ]
        Grant Ingersoll made changes -
        Attachment MAHOUT-524.patch [ 12502041 ]
        Lance Norskog made changes -
        Attachment SpectralKMeans_fail_20110919.txt [ 12495183 ]
        Lance Norskog made changes -
        Attachment EclipseLog_20110918.txt [ 12495016 ]
        Sean Owen made changes -
        Assignee Jeff Eastman [ jeastman ] Shannon Quinn [ magsol ]
        Sean Owen made changes -
        Labels clustering k-means visualization
        Assignee Jeff Eastman [ jeastman ]
        Fix Version/s 0.6 [ 12316364 ]
        Affects Version/s 0.5 [ 12315255 ]
        Sean Owen made changes -
        Fix Version/s 0.5 [ 12315255 ]
        Shannon Quinn made changes -
        Attachment spectralkmeans.png [ 12468940 ]
        Shannon Quinn made changes -
        Attachment aff.txt [ 12468658 ]
        Attachment raw.txt [ 12468659 ]
        Jeff Eastman made changes -
        Field Original Value New Value
        Fix Version/s 0.5 [ 12315255 ]
        Fix Version/s 0.4 [ 12314396 ]
        Description I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments it gets remarkably far through, finally failing on W.transpose() after the eigen cleanup. I can't imagine this would all be pilot error so I'm opening an issue to track it. I've committed a new display example that attempts to push the standard mixture of models data set through spectral k-means. After some tweaking of configuration arguments and a bug fix in EigenCleanupJob it runs spectral k-means to completion. The display example is expecting 2-d clustered points and the example is producing 5-d points. Additional I/O work is needed before this will play with the rest of the clustering algorithms.
        Jeff Eastman created issue -

          People

          • Assignee:
            Shannon Quinn
            Reporter:
            Jeff Eastman
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development