Mahout
  1. Mahout
  2. MAHOUT-879

Remove all graph algorithms with the exception of PageRank

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.6
    • Fix Version/s: 0.6
    • Component/s: Graph
    • Labels:
      None

      Description

      As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.

      I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

      1. graph-processing.tar.gz
        16 kB
        Sebastian Schelter
      2. MAHOUT-879.patch
        148 kB
        Sebastian Schelter

        Activity

        Sebastian Schelter created issue -
        Hide
        Daniel Xiaodan Zhou added a comment -

        Should people then use JUNG or other libraries for graph algorithms, or those algorithms will be put into a new sub-project on Apache? Thanks.

        Show
        Daniel Xiaodan Zhou added a comment - Should people then use JUNG or other libraries for graph algorithms, or those algorithms will be put into a new sub-project on Apache? Thanks.
        Hide
        Sebastian Schelter added a comment -

        I think Apache Giraph http://incubator.apache.org/giraph/ provides a promising approach for large scale graph processing

        Show
        Sebastian Schelter added a comment - I think Apache Giraph http://incubator.apache.org/giraph/ provides a promising approach for large scale graph processing
        Sebastian Schelter made changes -
        Field Original Value New Value
        Attachment MAHOUT-879.patch [ 12503538 ]
        Hide
        Sebastian Schelter added a comment -

        attached tar.gz file containing the removed graph algorithm implementations

        Show
        Sebastian Schelter added a comment - attached tar.gz file containing the removed graph algorithm implementations
        Sebastian Schelter made changes -
        Attachment graph-processing.tar.gz [ 12503539 ]
        Sebastian Schelter made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 0.6 [ 12316364 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        Integrated in Mahout-Quality #1175 (See https://builds.apache.org/job/Mahout-Quality/1175/)
        MAHOUT-879 Remove all graph algorithms with the exception of PageRank
        MAHOUT-879 Remove all graph algorithms with the exception of PageRank
        MAHOUT-879 Remove all graph algorithms with the exception of PageRank
        MAHOUT-879 Remove all graph algorithms with the exception of PageRank

        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201462
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java

        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201459
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/SortableIndex.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/VectorElementWritable.java

        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201458
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing/AdjacencyMatrixJobTest.java

        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201457
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/TasteHadoopUtils.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/als/ALSUtils.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/preparation/PreparePreferenceMatrixJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/AdjacencyMatrixJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/common
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/PageRankJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/model
        • /mahout/trunk/core/src/main/java/org/apache/mahout/graph/preprocessing
        • /mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/als/ParallelALSFactorizationJobTest.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/GraphTestCase.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/common
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/PageRankJobTest.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJobTest.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing
        • /mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/MathHelper.java
        • /mahout/trunk/src/conf/driver.classes.props
        • /mahout/trunk/src/conf/pagerank.props
        • /mahout/trunk/src/conf/randomwalkwithrestart.props
        Show
        Hudson added a comment - Integrated in Mahout-Quality #1175 (See https://builds.apache.org/job/Mahout-Quality/1175/ ) MAHOUT-879 Remove all graph algorithms with the exception of PageRank MAHOUT-879 Remove all graph algorithms with the exception of PageRank MAHOUT-879 Remove all graph algorithms with the exception of PageRank MAHOUT-879 Remove all graph algorithms with the exception of PageRank ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201462 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201459 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/SortableIndex.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/VectorElementWritable.java ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201458 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing/AdjacencyMatrixJobTest.java ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201457 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/TasteHadoopUtils.java /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/als/ALSUtils.java /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/preparation/PreparePreferenceMatrixJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/AdjacencyMatrixJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/common /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/PageRankJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/graph/model /mahout/trunk/core/src/main/java/org/apache/mahout/graph/preprocessing /mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/als/ParallelALSFactorizationJobTest.java /mahout/trunk/core/src/test/java/org/apache/mahout/graph/GraphTestCase.java /mahout/trunk/core/src/test/java/org/apache/mahout/graph/common /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/PageRankJobTest.java /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJobTest.java /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing /mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/MathHelper.java /mahout/trunk/src/conf/driver.classes.props /mahout/trunk/src/conf/pagerank.props /mahout/trunk/src/conf/randomwalkwithrestart.props
        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        Abbas Gadhia added a comment -

        There's an interesting project out there called reco4j that does Euclidean, Jaccard and Cosine on top of Neo4j.
        Just thought i'd call it out.

        Show
        Abbas Gadhia added a comment - There's an interesting project out there called reco4j that does Euclidean, Jaccard and Cosine on top of Neo4j. Just thought i'd call it out.

          People

          • Assignee:
            Sebastian Schelter
            Reporter:
            Sebastian Schelter
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development