Giraph
  1. Giraph
  2. GIRAPH-64

Create VertexRunner to make it easier to run users' computations

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, if a user wants to implement a Giraph algorithm by extending Vertex they must also write all the boilerplate around the Tool interface and bundle it with the Giraph jar (or get Giraph on the classpath and playing nice with the implementation). For example, what is included in the PageRankBenchmark and what Kohei has done: https://github.com/smly/java-Giraph-LabelPropagation It would be better if we had perhaps a Vertex implementation to be subclassed that already had all the standard Tooling included such that all one had to run would be (assuming the Giraph jar was already on the classpath):

      hadoop jar my-awesome-vertex.jar my.awesome.vertex -i jazz_input -o jazz_output -if org.apache.giraph.lib.in.text.adjacency-list.LongDoubleDouble -of org.apache.giraph.lib.out.text.adjacency-list.LongDoubleDouble

      This wouldn't work with every algorithm, but would be useful in a large number of cases.

      1. GIRAPH-64-2.patch
        14 kB
        Jakob Homan
      2. GIRAPH-64.patch
        15 kB
        Jakob Homan

        Activity

        Jakob Homan created issue -
        Jakob Homan made changes -
        Field Original Value New Value
        Assignee Jakob Homan [ jghoman ]
        Jakob Homan made changes -
        Attachment GIRAPH-64.patch [ 12501717 ]
        Jakob Homan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jakob Homan made changes -
        Attachment GIRAPH-64-2.patch [ 12503462 ]
        Jakob Homan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.70.0 [ 12317572 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Jakob Homan
            Reporter:
            Jakob Homan
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development