Giraph
  1. Giraph
  2. GIRAPH-92

Need outputformat for just vertex ID and value

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.1.0
    • Fix Version/s: 0.1.0
    • Component/s: lib
    • Labels:
      None

      Description

      We should have an text outputformat that just spits out the vertex id and value without its edges:

      index.html 0.9423

      This would be particularly helpful for further processing by, for instance, Pig.

      1. GIRAPH-92-2.patch
        7 kB
        Jakob Homan
      2. GIRAPH-92.patch
        7 kB
        Jakob Homan

        Activity

        Hide
        Jakob Homan added a comment -

        Patch with new format and unit test. One can switch from Id<delim>Value to Value<delim>Id via a configuration parameter.

        Show
        Jakob Homan added a comment - Patch with new format and unit test. One can switch from Id<delim>Value to Value<delim>Id via a configuration parameter.
        Hide
        Hyunsik Choi added a comment -

        +1

        Show
        Hyunsik Choi added a comment - +1
        Hide
        Avery Ching added a comment -

        I agree this could be useful.

        Couple of format errors:

        if (expr)

        + if(reverseOutput) {

        typo

        + public void testWithDifferentDelimieter() throws IOException,

        Interrupted needs one more space

        + public void testWithDifferentDelimieter() throws IOException,
        + InterruptedException {
        + Configuration conf = new Configuration();

        Extra line break

        + writer.writeVertex(vertex);
        +
        +
        + verify(tw).write(expected, null);

        Show
        Avery Ching added a comment - I agree this could be useful. Couple of format errors: if (expr) + if(reverseOutput) { typo + public void testWithDifferentDelimieter() throws IOException, Interrupted needs one more space + public void testWithDifferentDelimieter() throws IOException, + InterruptedException { + Configuration conf = new Configuration(); Extra line break + writer.writeVertex(vertex); + + + verify(tw).write(expected, null);
        Hide
        Jakob Homan added a comment -

        Updated patch per Avery's comments. Will commit this.

        Show
        Jakob Homan added a comment - Updated patch per Avery's comments. Will commit this.
        Hide
        Jakob Homan added a comment -

        I've committed this. Resolving as fixed. Thanks for the reviews.

        Show
        Jakob Homan added a comment - I've committed this. Resolving as fixed. Thanks for the reviews.
        Hide
        Hudson added a comment -

        Integrated in Giraph-trunk-Commit #38 (See https://builds.apache.org/job/Giraph-trunk-Commit/38/)
        GIRAPH-92. Need outputformat for just vertex ID and value.

        jghoman : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203379
        Files :

        • /incubator/giraph/trunk/CHANGELOG
        • /incubator/giraph/trunk/src/main/java/org/apache/giraph/lib/AdjacencyListTextVertexOutputFormat.java
        • /incubator/giraph/trunk/src/main/java/org/apache/giraph/lib/IdWithValueTextOutputFormat.java
        • /incubator/giraph/trunk/src/test/java/org/apache/giraph/lib/TestIdWithValueTextOutputFormat.java
        Show
        Hudson added a comment - Integrated in Giraph-trunk-Commit #38 (See https://builds.apache.org/job/Giraph-trunk-Commit/38/ ) GIRAPH-92 . Need outputformat for just vertex ID and value. jghoman : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203379 Files : /incubator/giraph/trunk/CHANGELOG /incubator/giraph/trunk/src/main/java/org/apache/giraph/lib/AdjacencyListTextVertexOutputFormat.java /incubator/giraph/trunk/src/main/java/org/apache/giraph/lib/IdWithValueTextOutputFormat.java /incubator/giraph/trunk/src/test/java/org/apache/giraph/lib/TestIdWithValueTextOutputFormat.java

          People

          • Assignee:
            Jakob Homan
            Reporter:
            Jakob Homan
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development