Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
These changes add two new kryo serialization classes (KryoSimpleWritable and KryoSimpleWrapper) which disable reference tracking at the expense of not supporting recursive and nested structures. Disabling reference tracking significantly improves the serialization performance. One a sample pipeline, the running time reduced from 75 minutes to 5 minutes.
Attachments
Issue Links
- links to