Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-1185

Adding faster serialization classes.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0
    • None
    • None

    Description

      These changes add two new kryo serialization classes (KryoSimpleWritable and KryoSimpleWrapper) which disable reference tracking at the expense of not supporting recursive and nested structures. Disabling reference tracking significantly improves the serialization performance. One a sample pipeline, the running time reduced from 75 minutes to 5 minutes.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yukselakinci Yuksel Akinci
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: