Hama
  1. Hama
  2. HAMA-594

Implementation of a Semi-Clustering algorithm, described in Pregel paper.

    Details

      Description

      5.4 Semi-Clustering

      Pregel has been used for several different versions of clus-tering. One version, semi-clustering, arises in social graphs. Vertices in a social graph typically represent people, and edges represent connections between them.

      ....

      This issue implements Semi-Clustering algorithm, described in Pregel paper, using Hama graph APIs.

      1. HAMA-594.patch
        31 kB
        R J
      2. HAMA-594_v02.patch
        33 kB
        Edward J. Yoon
      3. HAMA-594toml.patch
        52 kB
        Tommaso Teofili
      4. HAMA-594_v03.patch
        2 kB
        R J

        Activity

        Hide
        Tommaso Teofili added a comment -

        interesting, it'd be good to have a reference to the full paper

        Show
        Tommaso Teofili added a comment - interesting, it'd be good to have a reference to the full paper
        Hide
        Thomas Jungblut added a comment -
        Show
        Thomas Jungblut added a comment - http://people.apache.org/~tjungblut/downloads/pregel_paper.pdf The algorithm seems to be quite cool.
        Hide
        Tommaso Teofili added a comment -

        cool, thanks Thomas.

        Show
        Tommaso Teofili added a comment - cool, thanks Thomas.
        Hide
        Zh h added a comment -

        execuse me, but i can't find the link to the inplementation code of the algorithm on this page.

        Show
        Zh h added a comment - execuse me, but i can't find the link to the inplementation code of the algorithm on this page.
        Hide
        Edward J. Yoon added a comment -

        See Hierarchical clustering, and http://people.apache.org/~edwardyoon/documents/pregel.pdf (67~ 73 pages).

        Show
        Edward J. Yoon added a comment - See Hierarchical clustering, and http://people.apache.org/~edwardyoon/documents/pregel.pdf (67~ 73 pages).
        Hide
        Edward J. Yoon added a comment -

        Here's guide for you. Someone can implement this?

            @Override
            public void compute(Iterator<SCMessage> messages) throws IOException {
              if (this.getSuperstepCount() == 0) {
                // In superstep 0, V enters itself in that list as a semi-cluster of
                // size 1 and score 1, and publishes itself to all of its neighbors.
              }
        
              // In subsequent supersteps, V circulates over the received semi-clusters
              SCMessage clusters = null;
              while ((clusters = messages.next()) != null) {
                for (SemiCluster c : clusters.getClusters()) {
                  // If a semi-cluster c does not already contain V, V is added to c to
                  // form c’.
                }
              }
        
              // The semi-clusters are sorted by their scores and the
              // best ones are sent to V’s neighbors.
        
              // Vertex V updates its list of semi-clusters with the
              // semi-clusters that contain V.
        
              boolean updated = updateLocalClusters(clusters);
              if (!updated) {
                // The algorithm terminates either when the semi-
                // clusters stop changing or the user may provide a
                // limit.
        
                // At that point, the list of best semi-cluster
                // candidates for each vertex may be aggregated
                // into a global list of best semi-clusters.
                
                voteToHalt();
        
              } else {
                // The semi-clusters are sorted by their scores and the best ones are
                // sent to V’s neighbors.
              }
            }
          }
        
        Show
        Edward J. Yoon added a comment - Here's guide for you. Someone can implement this? @Override public void compute(Iterator<SCMessage> messages) throws IOException { if ( this .getSuperstepCount() == 0) { // In superstep 0, V enters itself in that list as a semi-cluster of // size 1 and score 1, and publishes itself to all of its neighbors. } // In subsequent supersteps, V circulates over the received semi-clusters SCMessage clusters = null ; while ((clusters = messages.next()) != null ) { for (SemiCluster c : clusters.getClusters()) { // If a semi-cluster c does not already contain V, V is added to c to // form c’. } } // The semi-clusters are sorted by their scores and the // best ones are sent to V’s neighbors. // Vertex V updates its list of semi-clusters with the // semi-clusters that contain V. boolean updated = updateLocalClusters(clusters); if (!updated) { // The algorithm terminates either when the semi- // clusters stop changing or the user may provide a // limit. // At that point, the list of best semi-cluster // candidates for each vertex may be aggregated // into a global list of best semi-clusters. voteToHalt(); } else { // The semi-clusters are sorted by their scores and the best ones are // sent to V’s neighbors. } } }
        Hide
        Mitesh Pathak added a comment -

        Hi Folks,
        I am INTERESTED in working on this issue!

        Cheers
        Mits

        Show
        Mitesh Pathak added a comment - Hi Folks, I am INTERESTED in working on this issue! Cheers Mits
        Hide
        Edward J. Yoon added a comment -

        Hi Mitesh, thanks for your interest. I'm looking forward your proposal.

        P.S., Please don't forget that theoretical understanding is first.

        Show
        Edward J. Yoon added a comment - Hi Mitesh, thanks for your interest. I'm looking forward your proposal. P.S., Please don't forget that theoretical understanding is first.
        Hide
        Edward J. Yoon added a comment -

        P.S., SCMessage = ArrayWritable<SemiCluster>

        Show
        Edward J. Yoon added a comment - P.S., SCMessage = ArrayWritable<SemiCluster>
        Hide
        Edward J. Yoon added a comment -
        == Motivation ==
        
        A semi-cluster in a social graph is a group of people who interact frequently with each other and less frequently with others. ....... This would be a valuable addition to the Apache Hama.
        
        == Project Description ==
        
        blah blah ....
        
        == Some implementation details ==
        
        ...
        
        == Project Timeline and Deliverables ==
        
        ...
        
        == About Me ==
        
        ...
        
        == References ==
        
         * Pregel: A System for Large-Scale Graph Processing Grzegorz Malewicz, Matthew H. Austern, Aart J. C. Bik, James C. Dehnert, Ilan Horn,.
        
        Show
        Edward J. Yoon added a comment - == Motivation == A semi-cluster in a social graph is a group of people who interact frequently with each other and less frequently with others. ....... This would be a valuable addition to the Apache Hama. == Project Description == blah blah .... == Some implementation details == ... == Project Timeline and Deliverables == ... == About Me == ... == References == * Pregel: A System for Large-Scale Graph Processing Grzegorz Malewicz, Matthew H. Austern, Aart J. C. Bik, James C. Dehnert, Ilan Horn,.
        Hide
        Edward J. Yoon added a comment -

        Hi Mitesh, please try to write a proposal like above my outline.

        Show
        Edward J. Yoon added a comment - Hi Mitesh, please try to write a proposal like above my outline.
        Hide
        Mitesh Pathak added a comment -

        Thanx Edward!

        Show
        Mitesh Pathak added a comment - Thanx Edward!
        Hide
        R J added a comment - - edited

        Hi ,
        I am also interested in working on this issue.
        Shall I join the team.I have got basic idea about hadoop and hama.
        Thanks

        Show
        R J added a comment - - edited Hi , I am also interested in working on this issue. Shall I join the team.I have got basic idea about hadoop and hama. Thanks
        Hide
        Edward J. Yoon added a comment -

        Renil,

        Sure, looking forward your proposal.

        Show
        Edward J. Yoon added a comment - Renil, Sure, looking forward your proposal.
        Hide
        Rishabh Garg added a comment -

        Hi,
        I am a sophomore, pursuing Computer Science and Engineering in the Indian Institute of Technology Delhi. I find this project very familiar as I recently implemented a model social networking site(20,000 nodes) where people were represented by vertices/nodes, and edges were used to denote the connections between them. The model had efficient clustering algorithms to quantify the frequency of discussion between the people and on a specific topic, using a timeline. Also the model had hierarchical clustering which, I feel, is a good way of describing clustering of such a high number of nodes(which is to be expected). I have a good knowledge of several clustering algorithms and have implementations of quite a few on my GitHub Account.
        I also went through the Pregel paper. The applications of the same are several. Also, I am trying to get familiar with Hama graph APIs. Any other pointers would be appreciated. Edward ? Also wanted to know if this is a part of GSOC'13 ?
        Thanks

        Show
        Rishabh Garg added a comment - Hi, I am a sophomore, pursuing Computer Science and Engineering in the Indian Institute of Technology Delhi. I find this project very familiar as I recently implemented a model social networking site(20,000 nodes) where people were represented by vertices/nodes, and edges were used to denote the connections between them. The model had efficient clustering algorithms to quantify the frequency of discussion between the people and on a specific topic, using a timeline. Also the model had hierarchical clustering which, I feel, is a good way of describing clustering of such a high number of nodes(which is to be expected). I have a good knowledge of several clustering algorithms and have implementations of quite a few on my GitHub Account. I also went through the Pregel paper. The applications of the same are several. Also, I am trying to get familiar with Hama graph APIs. Any other pointers would be appreciated. Edward ? Also wanted to know if this is a part of GSOC'13 ? Thanks
        Hide
        Edward J. Yoon added a comment -

        Yes, this is a part of GSOC'13. Please feel free to write the proposal and submit it to gsoc melange.

        Basically a theoretical understanding of clustering algorithm and distributed computer systems (Hadoop, Hama, BSP model, Pregel) is needed to complete this task.

        Show
        Edward J. Yoon added a comment - Yes, this is a part of GSOC'13. Please feel free to write the proposal and submit it to gsoc melange. Basically a theoretical understanding of clustering algorithm and distributed computer systems (Hadoop, Hama, BSP model, Pregel) is needed to complete this task.
        Hide
        Rishabh Garg added a comment -

        Thankyou for your reply. I have gone through the paper properly now and was successful in understanding the algorithm involved. Just trying to get practical experience with Hama and Hadoop. Would you like me to implement the sample code you had put around a year ago ?

        i.e.

        @Override
        public void compute(Iterator<SCMessage> messages) throws IOException {
        if (this.getSuperstepCount() == 0)

        { // In superstep 0, V enters itself in that list as a semi-cluster of // size 1 and score 1, and publishes itself to all of its neighbors. }

        // In subsequent supersteps, V circulates over the received semi-clusters
        SCMessage clusters = null;
        while ((clusters = messages.next()) != null) {
        for (SemiCluster c : clusters.getClusters())

        { // If a semi-cluster c does not already contain V, V is added to c to // form c’. }

        }

        // The semi-clusters are sorted by their scores and the
        // best ones are sent to V’s neighbors.

        // Vertex V updates its list of semi-clusters with the
        // semi-clusters that contain V.

        boolean updated = updateLocalClusters(clusters);
        if (!updated)

        { // The algorithm terminates either when the semi- // clusters stop changing or the user may provide a // limit. // At that point, the list of best semi-cluster // candidates for each vertex may be aggregated // into a global list of best semi-clusters. voteToHalt(); }

        else

        { // The semi-clusters are sorted by their scores and the best ones are // sent to V’s neighbors. }

        }
        }

        Show
        Rishabh Garg added a comment - Thankyou for your reply. I have gone through the paper properly now and was successful in understanding the algorithm involved. Just trying to get practical experience with Hama and Hadoop. Would you like me to implement the sample code you had put around a year ago ? i.e. @Override public void compute(Iterator<SCMessage> messages) throws IOException { if (this.getSuperstepCount() == 0) { // In superstep 0, V enters itself in that list as a semi-cluster of // size 1 and score 1, and publishes itself to all of its neighbors. } // In subsequent supersteps, V circulates over the received semi-clusters SCMessage clusters = null; while ((clusters = messages.next()) != null) { for (SemiCluster c : clusters.getClusters()) { // If a semi-cluster c does not already contain V, V is added to c to // form c’. } } // The semi-clusters are sorted by their scores and the // best ones are sent to V’s neighbors. // Vertex V updates its list of semi-clusters with the // semi-clusters that contain V. boolean updated = updateLocalClusters(clusters); if (!updated) { // The algorithm terminates either when the semi- // clusters stop changing or the user may provide a // limit. // At that point, the list of best semi-cluster // candidates for each vertex may be aggregated // into a global list of best semi-clusters. voteToHalt(); } else { // The semi-clusters are sorted by their scores and the best ones are // sent to V’s neighbors. } } }
        Hide
        Rishabh Garg added a comment -

        I have implemented the algorithm described in Pregel paper, without using Hama, to get a feel of the algorithm. The algorithm has been well understood now and I would like to show the code to you ? Any other patch or bug fixes are also welcome. Very much interested in this project. Learning more about Hama so that the semi-clustering algorithm can be implemented using Hama graph APIs.
        Thanks

        Show
        Rishabh Garg added a comment - I have implemented the algorithm described in Pregel paper, without using Hama, to get a feel of the algorithm. The algorithm has been well understood now and I would like to show the code to you ? Any other patch or bug fixes are also welcome. Very much interested in this project. Learning more about Hama so that the semi-clustering algorithm can be implemented using Hama graph APIs. Thanks
        Hide
        Edward J. Yoon added a comment -

        Nope, please submit your proposal to GSoC melange. then I'll review your proposals.

        Show
        Edward J. Yoon added a comment - Nope, please submit your proposal to GSoC melange. then I'll review your proposals.
        Hide
        Mitesh Pathak added a comment -

        Hi Edward,

        Here is my GSoC proposal.
        http://www.google-melange.com/gsoc/proposal/review/google/gsoc2013/mr_pathak/1

        Please check this and provide me some feedback.
        I will improve the proposal and correct the mistakes before the deadline according to your feedbacks.

        Cheers,
        Mits

        Show
        Mitesh Pathak added a comment - Hi Edward, Here is my GSoC proposal. http://www.google-melange.com/gsoc/proposal/review/google/gsoc2013/mr_pathak/1 Please check this and provide me some feedback. I will improve the proposal and correct the mistakes before the deadline according to your feedbacks. Cheers, Mits
        Hide
        Edward J. Yoon added a comment -

        Yes, I'll.

        Show
        Edward J. Yoon added a comment - Yes, I'll.
        Hide
        R J added a comment -

        Edward, Submitting patch for reviews.

        Show
        R J added a comment - Edward, Submitting patch for reviews.
        Hide
        Edward J. Yoon added a comment -

        Nice.

        I've reformatted the code to be inline with Hama project standards. Please use this formatter in the future. http://hama.apache.org/files/hama-eclipse-formatter.xml

        Show
        Edward J. Yoon added a comment - Nice. I've reformatted the code to be inline with Hama project standards. Please use this formatter in the future. http://hama.apache.org/files/hama-eclipse-formatter.xml
        Hide
        Edward J. Yoon added a comment -

        I've committed the patch and created a subtask HAMA-790. Please update your repository, and finalize this project by adding a unit test patch for the SemiClustering example.

        Thanks Renil J.

        Show
        Edward J. Yoon added a comment - I've committed the patch and created a subtask HAMA-790 . Please update your repository, and finalize this project by adding a unit test patch for the SemiClustering example. Thanks Renil J.
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hama trunk #151 (See https://builds.apache.org/job/Hama%20trunk/151/)
        HAMA-594: Semi-Clustering Algorithm Implementation (edwardyoon: rev 1511158)

        • /hama/trunk/CHANGES.txt
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/ExampleDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hama trunk #151 (See https://builds.apache.org/job/Hama%20trunk/151/ ) HAMA-594 : Semi-Clustering Algorithm Implementation (edwardyoon: rev 1511158) /hama/trunk/CHANGES.txt /hama/trunk/examples/src/main/java/org/apache/hama/examples/ExampleDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #997 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/997/)
        HAMA-594: Semi-Clustering Algorithm Implementation (edwardyoon: rev 1511158)

        • /hama/trunk/CHANGES.txt
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/ExampleDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        Show
        Hudson added a comment - SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #997 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/997/ ) HAMA-594 : Semi-Clustering Algorithm Implementation (edwardyoon: rev 1511158) /hama/trunk/CHANGES.txt /hama/trunk/examples/src/main/java/org/apache/hama/examples/ExampleDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        Hide
        Tommaso Teofili added a comment -

        I just noticed the semi clustering classes live in the examples module while I think they should be in the machine learning one, with a proper example then in the examples module, so most of them should go to ml module except for the SemiClusterJobDriver.

        If there's no objection I'll do the refactoring accordingly.

        Show
        Tommaso Teofili added a comment - I just noticed the semi clustering classes live in the examples module while I think they should be in the machine learning one, with a proper example then in the examples module, so most of them should go to ml module except for the SemiClusterJobDriver . If there's no objection I'll do the refactoring accordingly.
        Hide
        Tommaso Teofili added a comment -

        p.s.: that would bring the hama-graph dependency in hama-ml.

        Show
        Tommaso Teofili added a comment - p.s.: that would bring the hama-graph dependency in hama-ml.
        Hide
        Tommaso Teofili added a comment -

        here's the patch to move the relevant classes to hama-ml

        Show
        Tommaso Teofili added a comment - here's the patch to move the relevant classes to hama-ml
        Hide
        Edward J. Yoon added a comment -

        +1

        Show
        Edward J. Yoon added a comment - +1
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hama-Nightly-for-Hadoop-2.x #27 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/27/)
        HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361)

        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        • /hama/trunk/ml/pom.xml
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hama-Nightly-for-Hadoop-2.x #27 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/27/ ) HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361) /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java /hama/trunk/ml/pom.xml /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #1032 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/1032/)
        HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361)

        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        • /hama/trunk/ml/pom.xml
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Show
        Hudson added a comment - SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #1032 (See https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/1032/ ) HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361) /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java /hama/trunk/ml/pom.xml /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Hide
        Martin Illecker added a comment -

        Edward has also overwritten the ml/pom.xml and hama-graph dependency is:

        Index: ml/pom.xml
        ===================================================================
        --- ml/pom.xml	(revision 1521295)
        +++ ml/pom.xml	(working copy)
        @@ -36,6 +36,11 @@
               <artifactId>hama-core</artifactId>
               <version>${project.version}</version>
             </dependency>
        +    <dependency>
        +      <groupId>org.apache.hama</groupId>
        +      <artifactId>hama-graph</artifactId>
        +      <version>${project.version}</version>
        +    </dependency>
           </dependencies>
        
        Show
        Martin Illecker added a comment - Edward has also overwritten the ml/pom.xml and hama-graph dependency is: Index: ml/pom.xml =================================================================== --- ml/pom.xml (revision 1521295) +++ ml/pom.xml (working copy) @@ -36,6 +36,11 @@ <artifactId>hama-core</artifactId> <version>${project.version}</version> </dependency> + <dependency> + <groupId>org.apache.hama</groupId> + <artifactId>hama-graph</artifactId> + <version>${project.version}</version> + </dependency> </dependencies>
        Hide
        Edward J. Yoon added a comment -

        Thanks, Martin. Committed.

        Show
        Edward J. Yoon added a comment - Thanks, Martin. Committed.
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hama-trunk #171 (See https://builds.apache.org/job/Hama-trunk/171/)
        HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361)

        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java
        • /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java
        • /hama/trunk/ml/pom.xml
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java
        • /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Show
        Hudson added a comment - SUCCESS: Integrated in Hama-trunk #171 (See https://builds.apache.org/job/Hama-trunk/171/ ) HAMA-594 - moved semi clustering to hama-ml, added graph dependency to ml module (tommaso: rev 1521361) /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterDetails.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterMessage.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterTextReader.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterVertexOutputWriter.java /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusteringVertex.java /hama/trunk/ml/pom.xml /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterDetails.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterMessage.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterTextReader.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusterVertexOutputWriter.java /hama/trunk/ml/src/main/java/org/apache/hama/ml/semiclustering/SemiClusteringVertex.java
        Hide
        R J added a comment -

        Changes for current Graph framework.

        Show
        R J added a comment - Changes for current Graph framework.
        Hide
        Edward J. Yoon added a comment -

        I've committed this, Thanks Renil!

        Show
        Edward J. Yoon added a comment - I've committed this, Thanks Renil!

          People

          • Assignee:
            R J
            Reporter:
            Edward J. Yoon
          • Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development