Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-1185

Adding faster serialization classes.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: None
    • Labels:
      None

      Description

      These changes add two new kryo serialization classes (KryoSimpleWritable and KryoSimpleWrapper) which disable reference tracking at the expense of not supporting recursive and nested structures. Disabling reference tracking significantly improves the serialization performance. One a sample pipeline, the running time reduced from 75 minutes to 5 minutes.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yukselakinci Yuksel Akinci
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: